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ABSTRACT * _ ^ 

This document provides an evaluation of the 

Comprehensive School. Mathemat i cs Program (CSMP) for kindergarten 
through grade 6. Fbllbwihg an introductory chapter is a chapter on 

the develbpmeht arid nature of CSMP. Chapter 3 d iscusses CSMP 

implemeritat iori . Total student aciiievement scores on the Mathematics 
AppliecL^tb Novel Situations (maNS) tests are described in chapter 4, 
while chapter 5 discusses student aqhi eyement in i^ MANS 
categbiries. In bhapter 6, computation and standardized test results 
are presented. Other findings, including attitudes^ are disc^ in 
chapter 7, followed by a summary in chapter 8. Eight appendices 
include a list of the evaluation review panel members, their 
evaluation report^ a description of CSMP materials, and various 
evaluation instrument components . {>WS) 
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The Compreher^Ive _SchoQl Mathematics Program 

eSMP is a grades K-6 mathematics program Intended for regular classrodm ' 
use with students of all ability levels. The program wasNUeveloped by CEt^REL^ 
Ihc.^ an educational laboratory ftnded by the National Institute of Education. 
Distinctive Prbgrani Flaaturas 

Three representational languages - the Minicomputer, string pictures, and 
arrow diagrams - are used frequently throughout the curriculum, bothr to convey 
mathematical ideas and to pose problems. The currlculOm is highly structured In 
a spiral brgahlzatlbn with each lesson described in detail In the Teacher's Manual^ 
Ihcludihg a "script" corrpJete with sample question-and-answer dialogue. The 
lengthy lesson development extends the time the teacher normally spends in whole 
'group ihstructloh. CSMP emphasizes "mathematically rich" situations and builds 
ehttre lessons around such situations. There are no behavioral objectives nor are 
tests built Into the currlculurn, althbu^ student workbooks - 16-page booklets 
which are assigned once a week - give the teacher one method of evaluating 
student progress. The CSMP curriculum provides much less time for practicing 
computational skills and much more timie oh new content in probability and 
geon^etry. It introduces dec^aJs, fractions, negative hurribers, and the concept 
of multiplication earlier thaa usual, but does not stress computational mastery in 
these areas. ; 

Special Requirements ^ 

From 1 to 5 days of training heed to be provided for prospective eSMP 
teachers. This training can be done by a consultant from the CSMP network of 
turrt<ey trainers, or by "district personnel^ presumably the local CSMP Coordinator, 
who would also be responsible for monitoring the program, ordering materials, 
planning Implementation^ and general trouble shdotlhg. The prbgrami costs about 




as much to ^gin aslhg a reguldr textbook program, but costs more than a 
textbook to maintain because of Its cbhsUmable student materials; Because eSMP 
is not a textbook, it Is not likely to be approved in formal textbook adopUon 
procedures; ; 
Program jm p i ementatfon , 

CSMP Is being used In at least some classes In over lOP school districts, 
by about 55,666 students- It Is used In both Urban and rural settings, and as 
h a gifted and a Chapter I program). Most districts began using CSMP In a 
few kindergarten and first grade classes and gradually expanded to other schools 
and other grades, though this expansion seldom reached district wide .Lse through 
grades k-6, except in small districts. 

The most important fadtor in a successful CSMP Implementation fe the 
existence of a skilled and cbmmiltted CSMP coordinator with district-wide 



resiDonsibiiities. Coordinators report that the tyvo biggest obstacles in impleme 

CSMP are the training of teachers, especially the change in 'teaching philosophy 

1 

required by many . teachers, and the lack of computation practice in the program, 

CSMP teachers report spending more time in math cla^ than comparable 
Non-eSMP teachers, and they spend a higher proportion of the timie in teacher- 
led instruction. Teachers supplerrrent the program with computation practice, 
using about as^much time as Non-CSMP teachers do ih supplementing their 
program (usually with ••enrichment" activities). This supplementation is most 
commonly done a few minutes at a time or as homework. Many teachers, 
particularly in 'the upper grades, drop lessons fromi the Geometry and Prctoablllty 
strands ih order to complete the schedule. 
Prbgrann Evaluation 

CSMP was evaluated by a special group within CEMREL which operated ^ 
and was funded independently of the development team. This group produced 50 



evaluation reports over the 10 years of the Extended Pilot Tests of CSMP 
* materials. These pilot tests Involved 23 districts; subsequent Joint Research' 
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' studies^ Initiated and supported by loeal districts, Involved 1 1 other districts. The 
evaluation effort was monitored by art Independent 5-m'ember Evaluation Panel 
chaired by Dr. Ernest Hpose. ' 
Student Achlevennen^ _onL Standarrtf ypH Test s 

Based on over fifty eomparatlve studied, In over 600 classes^ It is clear 
that CSMP students perform very much the same as Mon-CSMP stutjeht| of 
comparable ability on a variety of standardized tests in computation, concepts^ 
and applications (or "problem solving"). In computation, there is a sll^t tehdehcy 
for CSMP stLKj§nts to do better than Non-CSMP students In grades K-3 and worse 
in grades 4-6. C^SMP students do not cfb as well in the multi-digit algdrlthms, 
like Icrig divisibn, though teacher supplementation In -these skills seems to improve 
perfbrmahce. ^ 

Student Achievement bh the MANS Tests 

__ ___________ . _ . _ > 

The MANS tests (Mathematics Applied to Novel Situatfohs) are a set of 
short ^tests^ different In each of grades -2-6, designed by the CEMREL. evaluation 
unit to assess GSMP students' performance In problem solving. The tests were 
needed because there were hb good standardized problem solving tests available. 
Many if the MANS tests present mathematical situations mfamiliar to both CSMP 
and fMon-CSMP students and hone of the tests contain any of the specific CSMP 
terminology or representational languages. Most^items are open-ended and problem 
oriented. The tests have been used by over 2D,D00 students during this evalua- 
tion. ^ . 

CSMP classes did better than Nbn-CSMP classes at every grade level and 
every ability level. The reajlts were statistically significant, throughout, based on 
Analysis of Covariance of class means, adjusted for reading scores. They were 
also; educationally significant because of the importance of problem solving, the 
iBual difficulty in improving studisnts' problem solving abilities, and the size of 
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the CSM^^ advantage (typical average percentage correct: 57% versus 50%^ or 
alternatively^ effect sizes of 1/3 to 1/2 of a standard deviation In favor of 
CSMP), ; >^ ; * ^ 

CSMP students were particularly good in process .dtlented tests^ especially 
solving and using number patterns and relationships, doing nnental arithmetic 
problems (sUch as i - 250 = 140), and producing multiple answers to prcblems. 
They were also very good in the special topic areas of Algebra and Probability. ' 
CSMP students had a more modest advantage In the MANS processes of Estima- 
tion, Number Representations, and Word Problems and there -was no different 
between CSMP and Non-CSMP studerits In the special areas of Geonnetry, Logic, 
and □rganlzatlon of Data. 
Other Findings 

0 Students, who completed CSMP K-6, were rated slightly higher by their 

. - i * ' _ ■ 

seventh grade mathematics teachers than former Non^SMP students, and 

received significantly higher miathematlcs grades^ though this advantage 
decreased with timie. 

o Students who transferred into the program, provided there were only a ^ 
few per class, scared slightly below- their veteran classmates on the 
MANS tests but above comparable Ndri-CSMP students. \ 

0 At every grade level, boys dUtscdred girls on all MANS categories 

except Computatidh and Elucidation of Multiple Answer^, in Estimation 

and Mental Arithmetic the advantage for boys averaged more than a 

quarter of a standard devlatidn (a little less for CSMP), a 

. / 

surprisingly strong result cdnsidering the ages of the students. 

0 In schools where CSMP was started In the same year, rather than K-1 

followed by a hew grade each* year, second grade classes appeared td\^ 

gain the full benefit of^ CSMP after one year while third and fourth 

grade classes made about half of the normal gain over Non^SMP 



Teacher Reactions 

Over half the teachers queried (over 500 In all)' gave unqualified approval 
to CSMP^ often describing it In glowing terms. About 1096-15% thoroughly' 
disapproved of the program. The remainder liked the prdgram overallj but had 
minor or major reservatldhs about siDme aspect of the program. CSMP was 
slightly more popular with teachers of grades K-2 thah^ih the upper graoes. . 
Teachers considered CSMP's challenging thinking skills and high student mdtivatidh 

as the best aspects of the program. They rated CSMP far better than their 

♦ __ " — _ — 

previous math program In overall quality^ student Interest^ reascihing ability, and 

^appropriateness for high ability students. On these last two items^ their ratings 

were over a full polnt'^ higher, on a |5-point scale^ than Non-CSMP teachers' 

ratings. * ' • 

Many teachers (about half) thought the program was poorer' than their 

-- - - -- - -- -- - ■ - - - - - -v_ §_ _ 

previous math program in student achievement in computation and in appropri- 
ateness for low ability students. These two common complaints surfaced in many 
ways, but were not well corroborated by test data which showed only small, 
easily remediable, computational deficits and very few instances of poor per-. ■ 
formance by low ability students. 

Con c lus ion * ^ ' 

CSMP is a difficult program to implemient; It requires more money, a strong 
coordinator, training and additionai preparation by teachers, and a change in 
teaching philosophy on the part of many teachers. The program does not seem to 
have much effect on standardized test scores. The program elicits a strong 
reaction from teachers, mostly favorable. The most important evaluation result 
is the improvement that CSMP makes in sttidents' ability to deS with various 

kinds ©fe>4DOvel, problem oriented, situations. Most mathematic educators consider 

- - • 

this ability to be very Important, very hard to bring about and very often 
ignored in favor of easy-to-measgre computational skills. 

E 
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The ebmpreherisive School Mathematics Program^ began In 1966. Lyndon Johnson - 
^-was president, the Great Socjety had peaked, and curriculurn development In 
mathematics education was In I^ts glory days with the recent work of projects like 
SMSQ, UieSM, The Madison Project,_and_SSN^ Gradually, CSMR became the 
last great dihpsaar of federal rnathema^Ics curriculum) develqpmqntj^^an _ajiachrpnlsm 
whose momentum (investment) and promise carried It through one challenge after 
anotheri • ^4 : ^ 

■ In 1969,- on^i^^f eSMP's senior advisors rer7iaB<ed to^ In effect^ 'Oh, It 

(eSMP) will never be widely used. This Is an experiment to see how good I 
program we can develop (without regard to Implementation considerations)." That 
remark turned out to be ah overstatement. 

Amazingly, GSmP did get finished, after many years and millions of dollars, 
threats to cut off Tuhding and changes In the national setting, such, as the 
financial squeeze in local districts, the return to "basics", and the testing/ 
: pcepuntabiHty movement, all of which hindered the program's dissemination 
' effort. Its completion and quality are a tribute to the determination and talent 
of Burt Kaufman, GSMP director for most if its existence. * 

But the remark illustrates one of the central problems in GSmP's development, 
which was finding a balance between, on the on@-^hand, the philosophy and spirit 
of what th,e developers thought miathematies ed^^it^^n should be (with "good ; 
mathennatics'' guiding all) and, on the other hand, considerations of practicality 
and implementation. Neither GEIylREb, the educational laboratory that housed 
and managed CSMR, nor the National Institute of Education, which ftxided 
CEMREL and GSMP, understood this problem clearly or fo^rmiulated a policy to 
deal with it. . 

The developers, however, had a clear vision of what theyl wanted and maintained 
this vision, as they deyelbped materials, bft_eh at -the cost of reducing thd' size of 
the potential market for their materials. The curriculum Is also viewed by' rnany 
mathehnatics educators as "extreme" - repetitious, idlbsyncratlc. Inefficient, and 
lacking key elements and varieties of approaches. Thus the program offends somie 
educators right away and for those who like Its approach^ it_presents protlerris in 
implehnentatibn. Given the resources invested, the amibuht of time provided for 
'development^ and the briHiahce of many of the ideas in the curricujumi, it's hard 
hot to come to the concluslbri that a golden opportunity was rHIssed. 

Nevertheless^ the program has been used in about 150 school districts and is how 
being' used by about 55,000 students. It is one of the, very few viifele alter- 
natives to the "national" curriculurn exemplified in virtually all availablejtext- 
books Irt elementary school mathematics. The formal evaluation of CSMP is how- 
complete and shows generally positive results, Including some hard to achieve 
student learning gains in certain areas of problem solving. The curriculum has 
been approved by the Joint Dissemination Review Pa^ eligible for NDN . . 

support. Gamera ready copies of the final, revised curriculum materials- h 
been completed. A set of extensive training materials Is available and H national 
group of turnkey trainers, the GSMP fsletwork, is in place. Estlmales for future 
sales revenues are alightly higher than: for costs of future printing, so that, witK. 
the creation of an inventory for the revised grades 4-6 materials, the program 
can be self sufficient. 

■ •-' ■ \ - . . ■ ■ . 



/ ^. ' 

The supreme irony of the CSMP. experience Is that, , afier aij this, after pafetlpg 
miillons of dollars and over' tWely.e ygars into CSMP^ the National instit^^^^^ 
Education is now apparently mwllling-id spend an additional 2% of that moaey to 
create this inventory, a one-time expense which w;ould ensure the future avsjl- 
ability of eSMP at precisely the tirtife that a .mathernaties/problenn solving . 
^ curriculum like GSMP is most needed and likely, to be in most demand. Within a 
■year the eSMP curriculurri may ho. longer be Available. 

This report summarizes CSMP evaiuatlon .results. The evaluation effort, ifke the 
development effort, has been long running and of wide scope. Testing has be^h ^ 
conducted in over 3D districts and gpO classes. . Questionnaires have been received 
from see t?aehers; 250 teachers'hai^ been interviewed. .The most notable 
accomplishment has be^n the development of the MANS Tests (Mathematics^ _ 
Applied to Novel SituationsJ, a series of innovative tests that have been used to 
compare eSMP and Noh-CSMP students In grades 2-6. v ^ 

Two eircditistances helped the evaluation effort imn-ie^urably. First, the ^ 
evaluation operated and was funded independently of the development grpLfi for 
most of its existence. Without this arrangement,- the integrity and quality of 
evaluation work Would have disappeared as would the program itself long before 
development was comipleted. Second, the evaluators were lucky to have an 
extraordinary group of advisors to work with, expeciaiiy the five-member 
Evaluation Panel from 1975-1983 consisting of ben Gahen, Bob Dilworth, Peter 
Hilton Ernie-^ouse and;. Stan Smith. They were helpful, talented, diverse^ in 
experience, and always prodding, in the nicest way, for the work ^ te done 
'-^-festter. The author wishes to acknowledge the work of Knowle^ Dougherty, ^who 
was part of the- evaluation, team during most of the Extended Pilot Test aid was 
eo-developer of the MANS Tests^ and Gail Marshall, another team member who 
wrote sdmie sections of ;this report. It was a good group. 

' The author has been the senior evaiuator Since 1958. He has fought the. usual ■ 
battles with the developers and the sponsors and has somehow managed to ajrvive 
to the end. Victors in war get to write the history books; evaluators who survive 
net to write the final report, in the case of- CSMP, both the history and the- ^ 
data are complex, and interesting; the author is grateful to NIE and McREL for , 
r.he chence to finish the job. 
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. H eSMP: DEVELdPfvENt AND DESCRIPTION 

I 

V ^ . Eblloso p by- and-Goals 

Like SMSG, UICSM,' the Madison Projeet and dthef mathernatics reform projects 
that_^receded it, CSMP was designed^ to teach "studen^ mathematles ^nd not 
merely arithmetic. Qne*of the key aspects of CSMP has been its cftjal emphasis 
■ oh both mathertiatical content ahd pedagpgy designed to support mathematical 
reasoning. As the program was developed, piloted aid revised, both content and 
pedagogy were modified to reflect classroomi experiences, « - 

.One bf.thp basic tenets which CSmP deyelopers have often stated is that' 
elemehtaty school mathematics shoaJd not unduly stre^ drill and practice in 
arithrrieUc cbmputatioh but,sh(Sjld-introdaee children to What the developers term 
"mathematically important ideas". - ' • ► ; ^ 

To present those "mathematicaily important ideas'' to' students, thre^ basic 
.principles guided the developers^ These principles, which differ from those on 
which "traditional" ^ext book mathematics .programs are based, are the following: 

Mathematics is a unified^bbdy of knowledge and should be organized and 
taught as 'such,- so that, for example, the artificial separation of 
arithmetic, algebra and geometry 'should not be maintained. 

- ' Mathematics as a tody of knowledge r^iuires certain ways of thinking and 
cannot be done by the exclusive use of memory. 

Mathematics is best learned byv students when applications are presented 
which are appropriate to studenrs!^^4ej4els of understanding and to their 
.natural interests. 

CSMPs point of view is also illustrated- in the following description of the cur- 
riculum, excerpted from materials prepared by the developer for prombtibhal 
purposes: 

*'An underlying ^sumption of^ U^^^ thjat children 

can learn and can enjoy learning much more math than they do now. 
Unlike most modern programs, the content Is presented not as an ^ 
artificial structure external to the experieheS of children, but rather ^ 
as an extension of experiences chijdren have encountered in their 
development, both at the real-life and fantasy levels. Using a 
"pedagogy of situations", ehiidren are led throu^ sequences of 
problem-solving experiences presented in gamie-llke and story 
settings. It is CSMPs strong^cbnviction that mathematics Is a unified 
whole" and should be , learned as such. Consequently, the content is 
cbmpletely sequenced In spiral form so that each student is brought 
into contact with, each area of content CDntinuousIy throughout the 
prbgram while building, interlocking experiences of increasing 
sophistication as the situations become more challenging. 
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"A feature chiqae to CSMP is the use of three nqnverbai iangaageis 
'that gwe chiidren immediate acpess. to mathema^^^ Ideas and 
methods nece^ary net only fdr'solvihg problems, but also for; 
continually expanding their uhdfr standi tig of the mathematical 
concepte themselves, through -these lah|tiages the curriculum acts as 
a vehicle that engages children immediately and naturally with the 
content of mathematics and its applications w[thout cumbersome . 
linguistic prerequisites. These languages irelude: the Language of 
Strings (brightly colored strings ^pd dots that deal with the _ ^ _ 
fundarpentalty tseful and Important mathematical notion of sets); the 
Language of Arrows (fcbldred arrows between pairs of dots that 
stimulate thinking about relations between objects); and the Language 
of the Papy Minicomputer. The Minicomputer, a simple abacus that* 
models the positional structure of the numeration system^ Is used _ 
both as a computing device and' as mot[vatjon for mental arithmetic. 
Its language can be used to represent the nature and properties of 
numbers. CSMP is flexible enough to facilitate whole-group, 
small-group, and personalized Instruction, and is appropriate for all 
children from the "gifted" to the "slow learners". It recognizes the. 
importance of affecj^iVe as well as cognitive concerns arid h:^ been 
developed ^d extensively tested in classrooms nationally. Thus, 
unlike many approaches to mathematics which believe that students 
need td have mastered their own language before they can handle 
' logical mathematical tasks, CSMP uses these precise, pictorial modes 
rather th^ relying exclusively- on verbal instruction td express the 
abstract cdhcepts embodied In CSMP content." 



14 




ERIC 



Th^ FDevelnpme nt ©f-CSMP 
_ 

Brief History _Qf_.CSMg 



Cbmprehehsive School Mathematles Program stands for btfth the name of a cur- 
ricUlufT. , CSMP, whose evaluation is the sabjeet of this report, and the narne"3^ a 
project which was responsible for developing eurrieulum materials. Two major 
curricula were developed under eSMP project auspices: CSMP, a mathemtatics 
program for regular classroom instruction, and the Elements of Mathematics (EM) 
program^ a grades 7-12 mathematics program for gifted students. EM treats 
traditional ^opics rigorously and in depth, it includes miuch of the content 
generally required for an undergraduate mathernattes major. These tv^o curricula 
are unrel;^ted to one another: but certain members o^ the CSMP staff contributed 
to the development of both projects. 



The CSMP Project was established in 1966, under the directibh of Burt Kaufman, 
who rennaihed director until. 1979. It was originally affiliated with Southern 
Illinois University, Carbondaje, Illinois. It was originally affiliated with Southern 
Illinois University, Carbbhdale, Illinois. .After a year of planning, eSMP was 
incorporated into the Central Midwest Regional Edut^ational Laboratory (later 
CEMREL, Inc.), one bf_the national educational .laboratories funded at that tirrie 
by the U.S. Office of Education. * " 

X _ _ - _ _ 

By 1968, CSMP had a staff of about 1> teacher-writers, artists, and evaluators, as 
well as a large and active group of consultants. Also involved with CSMP's 
development was a program advisory cdrhmittee^ chaired brigihally by_ Robert 
Davis and later by Peter Hilton and Gerald Rising^, and a CEMREL-wide advisory 
committee for evaluation, cKaired by Dr. Michael Scriven. 

During the initial development work^ third grade lessons were written. In this 
early development phase, the emphasis was on "activity packages" in which 
several class-length actiyi ties on a single topic were grouped together to form a 
single "package". Most of the students' work was on an individual basis, and a 
rrianagernent system was devised which included j^re- and post-testing and 
remediation strategies. Under this system, students occasionally worked in pairs^ 
and rT|any activities were ajccornpanied by audio-tapes whjch helped students work 
tfirough the exercises. Most of the teacher's timie was^spe^ individually 
with students while a teacher aide handled the manag^ent details. 

In 1970-71, an experimental comparison was made cGlng third grade classes in the 
Carbondale, Illinois public schools. This program, as it was developed to that 
time, was LKed in one group of classes, and a "stripped down", less expensive 
version of the same content was taught in a traditional way in another group of 
classrooms. The comparison showed there were virtually no differences !n 
achievement between the two groups of classes. 

At about the sanje tirne^ CSMP staff .also became aware of the work of 
Frederique Papy in Belgiumi. The staff began to develop kindergarten and first 
grade activities based on her work, which- used arrow diagrams, string pictures 
and the Papy rTiinicbrriputer to cbhyey mathematical ideas. These circumstances 
('yLM)tually led to the decisibn by the developiTient staff tiD abandbn the indi- 
vidualized approach used in the third grade materials in favor of the pedagogical 
and substantive innovations of Dr. Papy thus placing the teacher in the niore 
traditional rnle in group instruction. Meanwhile^ Uovelojjrrient continued frdrn 
secoficJ Gjrade^ a year at a time. 
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Iri ]972j the Office of Education conducted a review of all lab arid center 

development programs in anticipatipn- o^ their transfer-td- -the. J^ewIy 

National Institute of Education. The review recommended a phasing ^t of. / 
CSMP. However; a subsequent sjte visit by a three-person review team led t?. a 
recbmmiehdation that the almost-completed k-2 materials be given a pilot trial* 
They also recommended that development work be restricted to plannirjg . 
activities.^ending the results of the pilot trial. Early In 1973, a contract thrcugh 
1975 was signed with nie to conduct pilot .trials and to. complete curriculum . 
development through third grade? Then, according to that Jjontract, a decision 
about funding for further development wotW would be made. Thus begm the 

T extended pilot studies (1973-74), conducted by the evaluation staff directed b/ 

Martin Herbert, and monitored by an evaluation panel chaired by Dr. Ernest 

House, university of Illinois; Subsequently, an externa] review by a three-person 

; team, chaired by Dr. GaiJ Young, recommended In ^1975 that NIE continue funding : 
for development of lessons for grades 4-6. ^ ♦ 

In the meantime, the development activities came more and more unde^the 
direction of Dr. Papy, who had joined the staff as Director of Development, and 
the curriculum gradually took on its present form and ptjllojophy. In 1975, after 
the voluntary departure of mest of the development staff, and faced with a 
strained relationship with the Garbondale schools, the project moved to Sti Louis 
and was housed in a single facility with other CEMREL programs. 

In the fall of 1975, the development staff was rebuilt and developmental work 
began in two fourth grade classes -in the unlversitji City Public Schools, -a ra&ISlly 
integrated school district of inner-suburban St. Louis. In 1977 pilot testing ofj the 
fourth grade carriculum in r^ular classes was undertaken by the evaluation sfaff 
as part of the sequence of E*xtended Pilot Tests. 

In 1979, eiare Heidema became director of CSMP and supervised the completion 
' of development as well as the final revision of materials. This final revision 

occarred at each grade level in the year following the Extended Pilot Tests. The 
testing of sixth graders was completed Jn fall, 1982, and the final revised versions 
of all materials will be completed in early 1984. 

Devel opment Cycle ■ ^ 

By 1973 a four-stage process of^ materials development had been established and 
this procedure was followed in subsequent years. 

' 1. writing and Teaching Lessons' (1 year). The CSMP staff, led m Dr. Papy,__ 
gefierated short ^equencfes of lessons around a topic ahd then taught the lessons 
to two or three classes. The overriding 'criterion for selection/development of 
lessons was always whether the lesson themes or "situatidns" were mathematically 
lich, I.e. could easily lead in several ways to Important rnathematlcal ideas or 
ways of thinking. Also guiding development was the need to maintain a grade- 
by=qrade correspondence with the arithmetic skill development that is so well • 
established in American schools. Several observers watohed the lesson being 
taught, occasionally worked with individual students, and contributed to decisions 
on lesson revisions. These observations also affected future decisions about what 
to teach and bow to do it. Overall^ the classes were of average ability though 
they con tain edTi" higher proportion Of both high and low ability students than 
most classes do. 
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This f[rst stage of develi^pment distihiguished CSMPs develbphneht process for two 

related reasuns._ Firsts there was. _iid_ ove^^ master plan describing yyhat content 

woald be taught at which ^ra'^^^ filled in as \ 

time progressed.- Second^ the. daily teaching of lesions allowed for rapid, even, 
overnight, changes \^sed on 'student reactions- to the lessons. Thus, development 
was at the same tirr^fluid and empirically based, 

2. Local Pilot Test (1 year). This stlge was carried but by the develdpmef;]^ 
group and. was more a farther stage of development than a pilot trial. The 
previous year's lessons were revised and organj zed. Into a year long sequenge and 
taught in 6-8 classes in t^ie St. Louis area. 'Regular classroom teachers tau^t 

the lessons and were observed and assisted by CSMP staff at least twice a week. : J 

The proce^ was still informal and fluid during the local pilot test. Occasionally' 
CSMP staff vvould write lessqhs after observing a class period and thei^ bring 
those lessons with them on their next visit. CSMP staff often conducted lessons 
themselves. There was rp prdVisidh for ehd-of-year testing of student achieve- 
ment, though-^student performahce on wbrRbboR assignments was systematically 
reviewed. 

3. Extended Pilot Test (2 years). The first two stages resumed In a set of 
niaterials, the Final Experimental yersidn,-ithat Included bothg^^^ materials 
and^detailed Teacher's 'Guides to that grade level. Ii> the ^rit year of the 
Extended Pilot Test, about 10-12 classes in the St. Louis atei^ed the curriculum 
[n a more or; less "hands-of f " manner. Students In these clKses had tsed CSMP in 

* earlier grades, but teachers were usually- inexperienced with CSMP aid were 
trained in summer workshops lasting one or two weeks and conducted by CSMP 
staff. _ciasses were observed by both develtDpment aid evaluation staff, test 
instruments vvere developed^ and experimental comparisons were made between 
CSMP classes and similar non-CSMP clashes in the same district. Evaluation 
related activities were_ the responsibility of a special unit .within CEMREL which 
was independent of the development group. All expenses for materials and 
training vvere paid for by CSMP. Thus the first year of the Extended Pilot Test 
provided a vehicle for trying out the m.aterials in a small cghtrdlled experimental 
trial, and for developing training and evaluaticin prdcedUres for Use the following 
year. 

_ \ 

In the secQod year of the Extended PiliDt Test^ a much wider test of the 
materials was conducted in school districts nationally as well as in the St. Louis 
area. No condiUo or locatiiDn of pilot classes and 

partieipating school districts tp choose teachers and classes in ways 

eonsistent witK their own pilot needs. However, participating districts _were 
required to provide evaluation data as required by the evaluation staff 
(questionnaires, access to classes, student testing) and to cooperate in providiiig 
appropriate ecntrol classes for the comparison of student achievement. ^ Thi§ com- 
parison was accomplished m.ainly through the use of the MANS Tests^ .a special 
series of tests developed by the evaluation staff. 

Local districts were also required to pay the cost of instructional materials and 
to provide a coordinator responsible for several tasks: overseeing the Imple- 
mentation of the program, acting as a liaison between CSMP and the district, 
attending a suiTirner training workshop condaeted by CSMP, and subsequently 
training teachers as needed in their dhtrlets. 
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Appro«irr,ateiy 30-50 CSfvP classes cised the. materials in t^is . second year of the' 
Extended Pilot Test. The comparative stddie.s of student achievement. involved 
about 60 classes altogether, and _formed the main k)urce of data- ter- the 
SLiiTimative evaluation of the program; , - - 

4. Fihal Revisions. Based on various evaldatibh data, including .cifssrixim 
(pbservations^ te'actier reactions and student aehievertient, the Fjnal Experimental 
version was revised and a Final edition prepared- for nationwide availability. 
Puring this stage, extraneous lessons were eliminated, lessons were shortened or 
lengthened to reflect Ume limits at typical/ sites, and Teacher's Guides were 
revised to incorporate teachers' suggestiore or to clarify lessons. 

The years in which these stages were completed are shown below for each grade 
in Table 1- ' ' 

TKBCE 1 _ _ - ■ ' • 

Completion of tSeveldpieht Stages, By Grade 

pre 1973 73-74 74-75 75-76 76-77 77-78 , 78^:79 79-80 80-81 81-82 82-83 
^ * Develbpinerit ! ^ K~2 ^ 3 

Local Pilot: K'2 
Ejtend«d Pilot: 
Final Revision: - J* 



4,5 
4 

3 



5,6 6 
4 5 
4' J 4,5 

3 



6 : 
4,5 



Aside from student and teacher materials, CSMP has also documented ite goab 
and procedures in reports, ' artieJes, and program materials such_ as-Coordinator's 
manuals, workshop manuals, ar^ preview packets. A list of current document? is 
given in Appendix D. 
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CSMP Represehtatibnai Lahgdagg^ 

The next section describes the CSMP represehtatidhal Sangoages, wjtfr^verai 
•?5<arTiples of their usage. The readier rpay wish to skip ahead to the next section 
' C5MP Content^ page 19. / • ' 

Three pictorial devices - Arrow Diagrams, String f=>ictureSj and the Minicomputer 
-are used extensively throughout the curriculum as vehicles for presenting and 
worthing with a wide variety of content and mathematical processes, CSMP calls 
these devices "languages". The exan-iples csed below to Illustrate these languages- 
are taken from the Teacher's Guides aid student workbooks. If the reader will 
take the time to think about these examples, a good deal of the CSMP philosophy 
may become accessible. 

the Lyiguage of Arraws. 

CSMP Lfies colored arrow^tb represent relations an^ong numbers Or ob^cts repre- 
sented by dots. In the examples of arrow diagrams in this section, itches b^h 
necessary to ise solid end dotted arrows for different relationships. CSMP tees 
color to distinguish arrows, a nnuc^i more effective and striking visual device. An 
example showing hon-numerlcal relationships is gi«en, below, where each dot 
represents a different person. 

ydU are my mother ' Zeldai 

/ » 

you are my bro t her 



J 




Labelling all dots to show their relationship to Zelda* giWs the following: 

Zelda^n^^^ _ grandmother 

brother or sister # ^ Uncle 

Note the iQdetermi^^^ lower dot and fact that some arrows are missing, 

for' example from the uncles b the grandmother. 

■ .. _ _ . _ ^ 

In a nr.ore complicated example, shown below, every wl^cah be 'labelled **klp's . 

yoo ir* iy father you iri^ iy «6th#r 

' > 
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Arrows are; most often used to represent hbrherlcal relatlbhshlps. The picture 
below represents 2 + 3 = 5 - 





Note the "key" In .the previous diagram to show what the arrow stahcfe for. The 
diagram below represents the equation 3A ♦ 5 = 14. 




h 

If »i arrew can be drawi\In either direction between two dots, then the (tots can 
be connected by a chord, as Illustrated In the following hlghli^ts from a 35-page 
Story-Workbook for thirc graders. 

The princlpai of a certain school who was the rpmber^ and the vice prlhcIjDal^ 
the namber 1, made up the following rule In their school to reduce^ the amouat 
of talking: "Two numbers will be allowed to talk to one another only^If (Sie of 
^them is a multiple of the other." Very gradually some Interesting things are 
developed In the story book: 

b and 1 are the only ones who can talk to every b ody . 
each number can ^Ik to Itself. 

Two friends, 12 and 18, can't talk to one another but one of them h^ .the 
following Idea: 
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some numbers - cbmmbh multiples of 12 and 18 - can be Intermediaries 
for these two friends. 

The same thing happere to three good friends; 4, 10 and 15. 

some numbers, for example 2H, cfan talk to several frien* who are smaller 
thai they are. Others (priine numbers) can't talk to any smaller 
friends. " ^ . 
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Ah ihterestihg parade took place: 

^ 55 17 1© 




..2 B ^ 7 II 13 ^ 

f 

^ Find four numbeFS vstio- communicate as follows: ^ 



In the problem belbw^ third grade students have to label the arrow diagram with 
exuctly the dots shown In the string. 





Commcn multlpjes of 2 and 3 appear naturally Iri the partially labelled diagram 
below. 



i2 




Return -arrows 'are used frequently. One effective use Is in shov^lnj the rela-' ^ 
|dnship between multiplication and division of fractions, introduced^ fifth 
Tade. Multiplying -fiy 2/3 is split into two steps as *shown in the diagram below. 




V 



Return, arrows^ express moltiplleatidh and d^Ivlsibh as Inyerse operations. Hence^ 
the dblted return arrow n^iust represent ♦ 2/3 Jbdttom left). Alterrfetlvely^ return 
arrows for the upper arrows could be drawn first (bbttbm ri^t)^ In which case 
theVdbtted arrow represents the ebmpositlbh of a X 3 arrow and a ♦ 2 arrowi 
whidi is X 3/2. So ♦ 2/3 means the sarhe as X 3/2. 






J 



In the diagram below, it Is possible to determine which dots represent the 
and smallest numbers and what the dotted arrow stands for^ without actually 
labelling any of the dots. > 
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Mlnjedmpater 1^^^^ or more square boards, each divided iiitd four ^ 

squares and colored according to the Cuisenalre values so that checkers placed on 
it assunne the values 1, 2, 4 or 8. 



O 



8 



Numbers can be shown In several ways. The number 7 is represented below In 
three djiferent ways bjjt the* standard represehtatibh is the one dh the l^er left^ * 
where there is no more thai one checker per square, * ^ 



- - , , . . ... - ^ - . _ • 

Sevfiral boards placed slde-by-side correspond to the Vs, ID's, IGG's, etc. plaeej of 
the normal positional notation. 



'2H 



=57 



-mi 



Negative numbers can be ^own with special negative checkers used alone or in 
combination with regular checkers. 



J 



© 









= 18 



r 



79 



vyei^ted checkers havai numerals written on them to represent that many 
c+ieckers. ' 







® 










• 



=65 



A green bar placed between two boards represents a decimal 



id 



= 38 



1 3 



ERIC 



"Plays" are made by ^placing two checkers on a square (e.5. two 4's) with a 
single checkifr on tJbe next highest square (one 8) or vice versa; A special play , 
replaces a checker on the ei^.t square and a checker on the two square with a 
checker oh the one square of the next boarql; this special piay^ aid Its^ reverse^ 
9llbw pQays from bbard-tb-^^^ The actual boards may be/lar^e demian^tratidh 
boards used for teacher-led ihstrUctibn, smaller paper "boards" for individual 
student tee, or pictures of bbarcfe in workbooks allowing students tq give paper 
and pencil respor^es. 



The Minieompater ean be 
riamerical operations. 



csed to ealcalate with each of the four standard 



37 ♦ 58 = 



71 - 23 



3 X 46 = 





• 


0 


• 










6 













f 


0 


b 


6 




t 


•> 






0 
• 








••• 





iTBklhg plays slrrpllfies to 



cancelling sOlld checkers leaves 



itaklng plays slrrpllfies 



^ 9 






. t 


. 


• 




• 








0 


























• 









95 



48 



138 



52 ♦ 2 



First, 52 



Then, rraking plays tO' get two eJieekers per -square: 52 





• • 







So 52 ♦ 2 = 
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While the Mini has an obvious value for representing and cafcuiating with 

nurribers, it is also used as a device to stimulate mental arithmetic and to pose 
problems, particulariy in the upper grades. 



The following examples show a Jew of 'this kinds of problems that can be pc^ed. 

List the numbers that can be shown oh the one's board using exactly 3 
regular checkers. 

put ea::h rumber on the Minicomputer using a 5 checker and exactly one 
of these checkers: ® Q) ® ® W W ® 



= 33 



Use any two weighted checkers to show 25. 



Infinite repeating decimals can be lllustrateel by the following sequehee for 1/3. 
(Students will already have learned that division by 3 on the Minicomputer 
requires regrbi/ping into trios of checkers.) 



• 




i 












• 







•_ _ 


• • 



I -^3 







• • 


• • 

• 








• • 
• 


• • 
• 
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• 








« i 
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• • 

• 
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Ah exarrple of a strategy game starts with the Mihiebmptiter is shown below. ^ 
The game starts at zero and uses a single board; Teams take turns .adding a 
single dieeker to the board. The first team to reach 2D (without .gaing over) 
wins. Below is a hypothetical sequence of plays in a game won by Team A. 



Ttam A 



*4 



TtomA 



10 



Team A mm. 



^ r *8 Team 
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The 4-j 

Strings are used to show the classification of. cibjects accpr^iSg to certain 
attributes; Ydang students jni^t be asked to put dots for themselves in one of 
the four regions of the following string picture. Note that a girl without glasses 
would be represented by a dot out^de both strings. . > 





Strings are most often Lsed -in CSMP to classfl^' nurnbers. Jhe following string 
picture shows that 2 is the only positive prime which is a multiple of 2, duly 
rpted by the cross tiatehlng of the intersection to indicate that all elements of 
that region are shown. 
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starting with the diagram^ lower left^ the teacher might proceed a follows: 



Ask the class' for* ribmbers, and jDlace and label the numbers in the diagram. 
Give numbers to students to place and labeh 
Ask the class for numbers which belong In a particular region. 
AsR the class to name the intersecting j;egion of the diagram, which by now 
mi^t look like the one lower right. 



Mjltlples of ? fvbltiples of ?? 




Mjltlples of ? Mjltlples of ?? 



2 
7 

13 




Often pieces of information are given one at a time, allowing Inferences to be 
inade with each additional piece of Information. In the diagram at the bcSttom of 
the page, the problem is to try to figure out the labels for each string. The 
labels to be ctic^en from the following list: 

♦ ' multiples of 4, 
. J ' odd' humber§, 

• srh^Her than 10, 
positive divisoi^ of 12, 
^bsitive divisors of 18 or 
positive divisors of 24. ^ ^ 

After a few nunpbers hay^ been tested,^ the Inforrnatlon now available might be as 
represented in the diagrann; (A crowed out number m_eans that number does not 
belong in that region;) As It happens, all but one of these possibilities for each 
string can now be eliminated; 
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feiand calc ulators. 

Although not really a CSlvp language, hand ealeulators are used In many lessons 
for investigating numerical properties and patterns and In various games which 
reqUire^rateglc planning. 

An example of the use^ of hand calculators In a problem solving contest is to. 
assume that some of the keys on a hand calculator are broken leaving bhly the 
following keys: . ; . ' 



Try to display th§ number 54. Two relatively easy sequences of keys that 
produce 54 are 6 9 =^ and ' 

The number 540, howev^er, Is mach more diffieult to get oh the display, there 
are many solutions, some requiring many fewer buttons to be pressed than others. 
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C SMP Cohteht ari d Curriculum G rgahlzatlab 



The previous examples Illustrate the difficulty of separating GSMP cohteht from 
^pedagogy.. Probably the easiest Way to describe the cohteht of GSMP Is to show 
how It differs frdrt) whaL is LBually taught In the traditional program, blsted 
below are topics in the CSMP curriculum that are hot typically found in most 
pfograrrs. It Is Impdrtaht to note that describing these topics as thique content 
of CSMP does hot rr»eah that, as a result, siudents would ordinarily learn (know) a 
body of content In the usual sense. Each of the topics listed below is to be 
taught In dne^ or a few, teacher-led lessor^ In which a situation Is developed 
through gradual extensions snd problems. There Is ho body of facts or theorems 
to learn^ students ^e hot specially tested dh_the topics, and mastery of cdhcepts 
Is not usually required for the next topic. (Pedagogical cbhslderatlbhs are 
described In more detail later In this chapter.) > * 

Geometry. Constructidh of figures with translators^ angle templates, 
compass and straightedge; properties of shapes Ihdepehdeht of distance; 
parallelism and parallel projections; reflections arid symmetry; generalized 
distances other thai Euclidian (for example^ one^dlgit distahce, rhap 
distance, taxi distahce); tesselatldhs; the "map" of a cube; the triangle 
Inequality. 

Probability . Predicting snd comparing results of probabilistic experiments 
slnxilated by marbles, spinners aid dice; probability concepts ajch as 
randomness, equally likely events, fairness> selection with ajxl without 
replacement; comblnatoric aialysls of j^robabilitles; the multlpjicatron 
prlncIjDle i^^ multi-stage events; geometric sDlutlons to multi-stage random 
experiments. 

|S4umbers^-aid--r>jum TJieory. Prime factoring, modular arithmetic; various 
abacj_and posIHonal notaUo^^^^ 4, 8^ 2); codes and decoding 

In combinatorics; representation of fracJ;jons by infinite series; Intrqduc^^ 
to approximation^ and relative m^^ operations as 

functions, converses and compositions; negative numbers. 

bogle. fMegatioh of attributes; terminology (every, at least, at most, 
exactly); strategic thinking in special ^mes, 

Converseiy there are a number of areas in the traditional eurrieulumi that the 
CSMP curriculum does hot cover (or emphasizes less). 

* In the early grades there are virtually no lessons dealing w^th telling timie, ^ 
calendars, common Ehglish measures, aid coihs/mbney. Thie Teacher's 
Guides Inform teachers of this and ask therri to teaeh the^e topics ^their 

<. own way at the appropriate times. ^ 

Although CSMP students spehd considerable time wdrkihg with string 
pictures, the associated set termlhbrogy which appears Ih some fifth and 
iixth grade textbooks is hot used (e.g. set, ihtersectldh, uhioh, brackets, 
* etc.). There Is little usage of certain termlridldgy ih gedhietry, such as 
^isdscelese, equilateral, circumference^ arid pi. 



The curriculum calls for very little emphasis on cancelling with fractldhs^ 
and on multiplying or dividing of mixed numbers. 



number) Is hot developed as fulhy- as Is traBitionaHy dene In elertientary 
schools. 

There are very few word problems of the kind typically found In text 
books and standardized tests. 

Several topics are Introduced at an earlier level In eSMP, for exahple, fractIo_ns, 
especially taking bhe-nth of a number, and partitioning a sst of^ discrete objects 
Into equally numerous subsets, decimals, and the process of multiplication. CSNIP 
students learn about the concept of multiplication In first grade and are exposed 
to severarr Presentations of basic facb and how te calculate them. There are 
also many .Instances In first grade of multiplying a larger number by 2 or 3, such 
as 2 X 37. 

At the same Ume, numerical skill development proceeids more slowly, so that for 
example, the subtraction^ multiplication and division algorithms are not^practlced 
as early or as often as in traditional programs. Tfte subtraction algorithm Is 
developed later and in a different way then Is traditionally done, ^pte 
memorization Of multiplication facts "Is not emph^Jzed and the irultlpllcatlon 
algbrlthm of 2-diaIt b^ 3-digit numbers does ^ot get Introduced, let alone 
mlsterid, trtil fifth grade. Very little time is set aside for deyelopln^ sk 11 in 
the divisicxi algorithm. Though fractions are introduced early, the curriculum 
devotes less Ume to adding snd subtracting mixed numbers and common fractions, 
■ especially those with unlike denominatbrs. 

Grade Level Organization. The curriculum Is divided Into four levels: 
Kindergarten. , ^ 

Grade One, Parts I and II for first and second semester respeeUvely. 

Upper Primary Grades, Parts I and II (second grade) and III and IV (third 
grade). 

Intermediate Grades, Parts I to VI for the six semesters in grades 4-6. 

content JDroanization- In kindergarten and first grade the content is oW^zed 
I hd presentld" as a si ngle saqUence of lessons emphffilzlng elemeritary^arlthm^c 
concepts and their exemplification in the CSMP languages. In the other grades, 
content is organized by foUr strands: 

The world of Numbers 

The tanguages of Strings end Arrows 

Geometry and Measurement 

Probability and Statistics 

'^The Probability and Statistics strand begins In fourth grade. The ^ String ^d - 
Arrows Strand Is concerned with logical thinking arsj reasoning skills _ thou J It 
also contains a good "deal of number work, either directly or as required durfaig 
the course of lessons primarily concerned with other objectives, such as strategic 
thinking. 

30 
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Sarnpl e Se quence of Les^ns, ' Within each strand there are blocks of lessons 
dealing with the same Idea^ which Is developed further with each lesson. An 
example of an unusualiy long block of lessons with arithmetic develojDment Is 
given below (most blocks are 2 or 3 lessons long). The lessons are from the sixth 
grade geometry strand. 

The sequence begins with two lessons about circles. Students collectively draw 
many circles^ all j^asslng through a fixed point, but whose center Is alwaxs_^n_ 
another given circle. (First the fixed point Is outside the given clrcle^ th^^ 
itj then Inside it, each tirne producing striking resultsO Varl^ 
asked about srpallest circles and abou^^ effect of rriovlng the fixed point 
slightly, or even all the way to Ah^.P^D*^^? 9^ given circle. The second lesson 
cmcludes with ccristructjqn of lattice by successively drawing new circles whose 
centers are previous points of intersection and- then joining these points of 
intersections 

Then there is a sequence of nine lessons in which the teacher helps students to: 

draw perpendicular lines using a paper square as a corner, 

draw closed shapes containing only right angles, 

construct perpendicular lines with compass and straightedge, first 
points on a line, then from points outside the line, 

construct equilateral 8-sIded polygons with compass and straightedge, 

draw all the p«sslble quadrilaterals each of whose sides must equal one 
or the other of two given lengths, 

do the same thing for triangles^ 

determine where a stick of fixed length could be broken twice and so 
that a triangle could be 'formed frorn the pieces. 

three lessons on estimating the prctoability of two random breaks of a 
stick producing pieces that could form a triangle. 

\ \ ^ 

Included in the strands are sets of lessqns,^ on various probability, reasonIng,^^a^^ 
number games; the games have rules vvhlch^can ^e changed to make the game 
(Tiore challenging or to feature some new mathematical idea. 

Schedule Organization . The ^hedule is organized in a spiral fashion by days of 
the we^. On two days of the week, e^g., every Monday arid Thursday, lessons 
come from the World of Nunribers Strand. One day of the week is devoted to 
workbooks which provide practice and problems frori-i recent lessons in all strancfe. 
The other two days of the week are devoted to the other strands: in grades 2 
and 3 a each for the Geometry and Me^urement strand and the String and 
Arrows strand and In grades 4-6'rogghly equally divided among these two strands 
plus the Probability and Statistics strand. 

A suggested sequence of lessons for the last nine weeks of second semester,, third 
grade, is shown on the next page as ah example of schedule brgahizatibh. Each 
column is for a day erf the week. 

- V 
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N3i Hind-C«4cu&tOf 

N p. 2«l 


LIS Th« String C«n« 

LP, W3 


N32 Oiviilon Problami 

N p; 2&4 


WIS nsHiNG roil NUMicRS 

(Laiion 1 ) 

W p. )U 


GI2 Tourlr^ Houaoa •! 

O p. ill 


17 


N P. 2ii 


Lli T«K«ti«M Nuirb«ri 

L P, IJI 


NI4 RoAdi wlih Cordi 

N p. 271 


WU riSHiNG roil NUMiciis 

i Utaon 2 ) 

W p. 119 


ADIUSTMCNT Wt 




NJS Mirucofliputar Golf •] 
N P. 271 


L17 MulUt^UcAUOn 
Modulo 10 a2 

L^. 117 


ADIU5TMCNT 


Wl7 A Short Story about 
Thraa frlandi 

w p. Ill 


Gil rai^ii trvcinoa 

o p. in 



• Fig. 1. Sarrple 9-wea< schedule of lessons, third grade 

During any given week, students will ehcdUhter a wide variety of activities. In 
reading down any column, it can be seen that many topics appear more than once 
(and will reappear many times over the course Of the full 36-wed< sequence for 
the whole year). This is especially true of lessons whose names are followed by 
Each lesson reviews the previous one and takes the idea a step further or 
into a new direction. 

CSMP believes that different cJiildreh learn at different Umes and at different 
rates and since learning is not heges^arily a linear process, this spiral organization 
gives each student new chance to work with an idea at each turn of the spiral. 
Thus, according to developers, when students return to a topic a week or two 
lat&, some who did not understand the cdncepts the first Ume around may now 
be Tsetter prepared to work dh the ideas. 

Each grade level has its own prescribed schedule of lessons which is presented in 
the Teacher's Guide. The Kindergarteot schedule has a linear sequeixe of 168 
lessons -spread over 9 midiths (i.e. aboiS 3 per week). At other grade levels, 
lessons are grouped on a days-of-the-weg< basis, like the portion of the third 
grade schedule shown previously, and range from 150 to 180 lessons dependtfig on 
grade level. Included in the schedule are "AdjustiTient Days" to allow for hoi: days, 
snow . days^ etc. 

One other feature of eSMPs curricu^urn s^ It apart from nr,Dst othir curricula. 
Many other programs have built-in testing prpgrams (for example, tests in the 
teacher's edition) which specify behavioral objectives for each unit. CSf^F has no 
behavioral objectives and no program devised tests. Instead, teachers ^arie . 
encauraaed to ga_u_g_e students' progress and assign grades to students cri the basis 
of classrdoir. responses and perfbrrr.ance oh the weekly workbp* assignrnents. . :.. 
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Materials 



:*s_6mrie_jSiiLIridivIdual Lessons. 



The Teacher's Gaide contains a multi-page descrlptlbh of each lesson. Each 
r ,i, lesson description has several parts: ah overview which describes the lesson's 
- ' : ; purpose, a capsule summary of each jDart of the lesson, ||||"sc rip t" for each lesson 
' wfiich accompanying diagrams and examples, and asslgimehts for 

ad.ditiohij student work. A lesson from the third grade Teacher's Guide is shown 
b^low. The lesson can be found In the schedule shown oh the previous page. 



Write ih«se wurdt on the board. 



CAPSU.IE LESSON SUMMARY , . J. _ __ ' 

Explpre_ ihe ef (e_ct_o' '"ovj n^g.y a rlpu$_ checkers in a conflgurailpn 
on ihe Minicomputer — a h_er_ A nPV* .^^*_!'?_^_^Af_y^_' « AAI?*''*'.- 
or tb« tame number on thtf Mlnlcomp^^ 

gl the (jame " Minlcompuier GoH ' . In which checkers are moved 
from a starting configuration In order lo reach a specific goal. 



MATERIALS 

teacher : 
Stude nt : 



Minlcompuier set: colored challc 
None 



DCSCRIPTION or LESSON 

t^f relit I 



T: I am goln|g to put a number on tfttt Minicomputer. S«e If you can 

figure out which number It Is. 



Griuiueiiy put thli configuration on th« Minicomputer, starting with the chicKst^ 
on the squares of largest value! Pausa Iriquehtly io your j 
mental calculations 1 



rtlng with the checKstO^ « 
studerits cari do the ]L 



Lmt the students whisper the number to ybu before letllhg OT>e of thef^ ahsWer 
eioud. / 

S: ^ . ^ " / 

Invite several itiidenti -.o explain how they knew this number wes .37. 



More 
Scirne 



I am golf>g to move one of these checkers to another ^quAre. Tell me 
^ If the new number is more than, less than, or the same es the num> 
ber on the Minicomputer now. ' 



Move a checkar from the 2>square to tha 1- square. 

Poini to eech of the w^ds on tha board in turn end esl( tha stiidahti to hold up 
their hinds when you point to tha wOfd which describes the new humbar. Dia 
students should Indicate that tha haw numbar IS laii than bafort: 



T: 



How much laas . . . 7 ' 



^ Repeat thli^activity several lifriai aa euogastad balow. Do jj^t return chackars 
to their original positions. Each rnova will itart from a riaw number oh tha 
MirUcofupuiar . * . 

Move a checker : 

a fricnn tha 4-square to tha 1 'Square (3 less) 

a Irom-ths 20- square to tha 40>squara (20 more) 

a from the 10' square to <ha 2-squara (8 less) 

a from the I'-squera to the lO'squera (9 more) 

a from tha 8-square to tha 4>square (4 lese) 

a ttvm the 8-squere to tha 2-S9uara (6 lasa) 



Fig. 2. Sample Lesson- from Teacher's Guide^ Third Grade. 
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Vu\ this t onligui Jl it)H i-n if>»- MnUcOinput»M 



Wl»o c«»n move CMactiy one checker and make the number 2 more iHan 
U U now y 



A aiudani movei a checker from the 2>t quart lo Cha 4'tquara. 

Cohlihua thii acUvUy by aiklrig (or volunlaara lo make thaia thanqai. Again, 
do r^Curii checkers lo their original* poalUoni ; oiharwlia, lOina changai may 
be Impoiilbla. * 

a 9 mora (from th^l-squara lo the iO-s<|uera) 
e 19 more (from ihe I-iquara lb tha 20-iquara) 
a 10 ieia Urbm the 2otiquara lo the lO-equara) 
a 3 ieii (Iran the 4-iquara lo the I-iquare) 
e 30 leei (from tha 40-iquara lo the 10-squara) ^ 
a 6 mor* (from the 4'square lo the lO-square or from the 2-iquara. lo lha 
e-iquara) 

e 99 mora (from the 1 -square lo the 100- square) 
Cj c a iC l ie 2 : Minicomputer Golf 

Put this configuration on the MiKlcbmputar . r 



What number Is this? 

S7 . 



T: Toddy we oie ybing lo pl*/ « game called " Mlnlcofnpuier Golf," 

Draw and iai)«I a doi lor 57: 

T i Our goal 1$ to reach 200 by moving the checkers. 

■4 

Draw arvd label a dot for 200- 

T; bo need to make the number dfi the Minicomputer lerger or smaller? 

is : Larger;; ^ 

» Invlt. e student to move exactly finft checker from any iqu^t^ lb iny othar aquara 
of tha Minicomputer. When Ihe checker has bean mbvad. ask l^« 
muth ii»V«r or imaller ii ihe r»iW numbir: If lha eludenl Is unable ^o tall yoo^ 
raplec^ the checker In lii p^vlboe poilllon end esk lha student lo maka another 
mb^^a. Continue In this way until (he goal Is reechad. TTta mova which reaches 
the goal it the winning mova. Wa describe e sempla geme. 

The first volunteer moves a checker from the 2-ec|ijari to the . 



• 


• 

• 




• 
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ia the new number larger bf emeller lhan lha number bafora? 

■ « 

La roar . 



S 1 M l<tig4M . 

A ♦ is aifOw siartiiig at S7 iwiorai the Incfi-asf. 



+J8 



57 



200 



What number li 57 ♦ 187 (75) 

Sbm^ iludinli might look at lha Minicomputer to calculate the number (7S): 
fe^rs mlghi db tha addition mantally^ If necessary, wrtla the addition problMi 
I the bbf id end solve It coUectlvaly, Label the dot with tha enswvr. 

Thm ne^ volunteer rtovis • chickir from thi 1-i^tSri ib the lOO-iquai* end 
talla the cless that the rwmbar is r*bw59 lirgar: Ttia clasi i»lcuUt»a end 
rinds that 75 ♦ 99 - 174, ai^d eb decides thet the new mimb^ Ae 174, ^ 



57 



+J8 



75 



too 



bo wa ne«d to make the number on the MInlcomputar lergar Of eMUar? 

(Larger) 

How much lerger . ^ ■ 7 (26) 



A stSdenl moves a checker from the 4>square lo the 20 -square. 



+18 

57 



75 



> > 



no 



200 



What it the number on the Minicomputer now? (190) 
What i» the dlstvince from 190 to 2007 

10 ; we nood to make Ihe number 10 more. 



A student moves a checker from thi 10-square to the 20-squara and tha goal 
la reached . 



+J8 



174 



+16 



no 



+10 



51 ys 

r\mi <h« game • Mcond (liM boi iiiri WiSJj Oili configuraiton . 



200 



= 39 



. ar«d set lha goal at 200. 



9^ 



If your class wiihei lb play other gemae of MInlcomputar Golf, wa suggast 
that ^ ilirt With iny rnintbar represented by eight poeltlve a»^c)^ on di# 
MInlcompulir *r>d choose any multiple of 100 up lo 1 .000 as ^r Of 
bburii thar* ahl other cholcoa. b«^ iKay; «Uy t« dlHlculi tor itti»iili 
or they mey ra<}ulre oelculeilons %vhlch "low tha gema down to tho point of 
bacoming bortng. 

34 lEST G0PY AVAyBLE 



As this sarrple shbws^ CSMP is_ very teacher-directed. Teachers are ehcduraged 
to follow the Teacher's Guide fairly carefully until they brcbrrie cdrrifortable with 
the kinds of questidhs aid procedures Intended, _ Because of CSMPs highly 
structured schedules end lessons, the Teacher's Guide is the crucial prdgrarri 
vehicle. It provides support and ihstructidh to the teacher from training^ through 
practice of the lessons^ and on to eventual mastery of the content arid pedagogy. 
The guides^ tend to be Ibhg; the Kindergarten Guide Is 514 pages, while the guides 
in other grades average abbut 150D pages and are divided into several vblumes by 
strsih(S &^6 semesters. 

The lemons are based qr) a "pedagogy" of situations which, are designed tS feature 
both, real world and fantasy situations. Numbers may be Imbued with person- 
alities and fantasy roles whleh support their miathematlcal prbpertlesi Two 
hambers, zero and brie, are shown below as Uiey appeared In a storybook Cas the 
principal and vlce-prinelpal In the story abouf talking^ numbers, described earlier 
In this chapter). 
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In presenting the lessons^ teachers can use a variety of materials designed by 
GSMP to illus rate key concepts, for example, a string giamie set (strings, ealored 
geometric, shap^s^ and score pads) or a large miinicompater with magnetic 
checkers (plus smaller sets for students to use). 

■ t 



W Teacher's Guide prepares teachers fojr Ways of c^jestlbhlhg that do rot 
frequently' occur in most teacher-student clSssroorri Interactions, For examplei 
ways of eliciting multiple answers to Wie ^me problem are often modeled^ as 
shown below from a portion of a secon^^rade lesson plan. 



Allow dii ducuaaion m oonilnua tot a whiJa If tha luidanu ramaln Inivraitad. 
Cnoour^a a vartiiy of bbiarvaiioiM : YoU ■ay alio wl«h io fi^ida tha Oiacui- 
aloh by aiklng ^uaationP of your own. 

T: MIchaal vM ma ihat ha gava iha nott May batkau. Whara la 

MlcKaal? Now many Hay biikau did ha glva? 

i : Four . 

_ _ _ _ » 

Hav« a atudani point tb Kllchaal'i dot: labal thli doi "Mlchaai". 

t: Can you firS a child who gava axactiy ona May baikai and rocaivad 
•xactly ona May batkat? 

Encouraga th# atudonu to Und aavaral^auch cKUdron. 

T: Mlchaai'a frland Po9gy racaivid Iha May biikoii. Wham U 

raggy? How many May batkau did sha r«c«lv«7 

i : riva : 

Call on a inidant u point to iha dot to Foflffy ; 1»*>*1 "PoQW". 
t : rind pain of chiidran who gava May baikati to a«ch olhar. 

Thara «ra iawal auch p«Ui : ancourag* tha daia to tlni t^am aU. 
I : What do you thlnJt about iha chUd with iha U»p? 
I : Ha gav« a May basket to himtalf . 

T; Bow m«ny May baakau wara givan all «og«thor? < J<) 

ik>^ iiny May baakau wa Nrcaivad 4U togot^ («) 



Stod eot Materials 

The main student materials are consumable ^rt<books and worksheets. Workbooks 
are typically 16 pages in lengthy and are__intended to complement in a general 
way the various teacher-led lessons. There are between 12^and 16 of these ^ 
workbooks per grade. They are graded in difficulty, from one star (all students 
should be capable of doing the problems) to four stars (only the best students 
wiil be able to do them) and are to be assigned IndividuaHy by the teacher 
aceortina to the ability and progress of the student. Wort<books are ^signed 
once a weS< and are often preceded by a teacher-led lesscri to give students a 
preview. The schedule sjDecIfies when, each workbook shoujd be ^signed; normally 
r two or three consecutive wdrkbodk days are alloted for each worW)ook. Teachers 
grade the workbooks accoitlihg to . their own criteria and needs. 
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Arother frequently L^ed kind of student material is the worksheet. Worksheets 
are UsUaily assigned for Individual student work after each teacher-led lesson^ 
LgUalJy one or two per le^on, aceording to directions in the Teacher's duide. 
These worksheet appear altogether in a single, bounds consumablii book| con- 
taining between about IpG and 20d individual worksheets per grade. 

The prograrri^s emphasis on problem solving is also fostered by "Detective 
Stories'*, like the one shown below from a fourth grade student woii<book| which 
encourage students to form hypotheses, consider aiternativesi and test conclusions. 



ton is • Merit nomter. 

Ton Is In ihls irrpw pidurv ind In this string ptdurt . 
Who Is Ton? 



cin be put on thf Mlhjcomputcr 
«vNh- ont ctitdctr 




muttlptet ot 20 








Cost of- 

The approximiate cost-per^^^ of all materials^ t5ased on present^ moderate- 

sized printing rure^ is shown below for kindergarteni grades 1-3 (average) and 
grades 4-6 (average). 

Table 2 
Materials Costs J=;er Student 

Installation (Year 1) Subsequent YSars 

K 1-3 4-6 K 1-3 ^ 4-6 



Teacher N^terials $1.50 $2.30 $3.70 

Student N^teria is $3.70 $6.20 $7.10 $3.50 $5.60 $6.70 

Entry Modules 

Special sequences of lessons have been develpped for use jwith new-to-CSMP 
classes who are beginning thirds fourth or fifth grades. (For hew second grade 
classes there is a reyiew built into the curriculum^ which teachers can Lse in 
somewhat expanded Iform.) These lessons are intended to give Students a rapid^ 
intense introduction to the CSMP languages so ' that classes can f^^^ into the 
regular sequence with a delay of no ♦ more than 4 or 5 weeks at the upper grades, 
less at the lower grades. These modules make it possible for school districts to 
begin CSMP in several grades at the time, instead of implementing the usual 
yearly grade-by-grade advancerr.ent from K-1. 
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Ir alhlrig ahd Coordination " 

bufing CSMPs devel5pment and evaluation, ^^'^st "teachers wer^^^^^ fc th|lr 
local district by the CSMP coordinator. Some were trained dir^ectly by ^C^^^ 
SSrand other^ By coordinators from another district. Recently, a netvyoi1< of 
fJrnke^ Tral^^ers, trained by CSMP staff, has- been established to assist local 
districts. ^ / 

The mechanism for tralning^irrplementatlon was a crop 

Memorandum of Understanding. Once the ^emie^t^^^^ Jffb 
asked to appoint a local coordinator and to ^end that person tfi St. Louis Tor 
fayfof training This training Usually occurred during th?, spring or ^mmer prior 
to Ihe fiS yea of implemeh^tldn. In turn, the coordinator^ Plumed resppn- 
• sIblliS for training all new-to-CSMP teachers before the start of school. The 
smallest permissible adoption i/iit;was one teacher in one classroonn. 

A Coordinator's Manual and iridi vrdgal gaining kits for ieac^^^^ for 

^e¥^ teacher training. The manual presents formats for two woiKshops: 

Primary lnd ^.termed?ate. Vsoth syllabi cont^ * "^"^^^^e,^^ 
and to the CSMP languages. Workshop 9^'^''^'^^^/]%^^^^ SuSThe^me 
the program in much the same way as students v^odld, I.e., they study the same 
problems end exercises that appear- In the curriculum. 

The workshop schedules are arranged In five 6-hour blocks. ^he primary level 
it ITecdmmended that first grade teachers attend for the flr^ ^FH^^Ih?Jd 
workshoD that second grade teachers attend the first four dayj, and that third _ 
oSde t&hers bf pSsint for all five days. (The nurnber of days can be reduced 
gy one In aaS. cas'e if necessary.) " is acceptable for these ru.m^^^^ 
5e reduced by one each. Gtades 4-6 teachers are expected to attend all "vf days 
of tiS TnSrmedlate workshop. The schedules allow Ume for partLcipants to look 
through ^eSSr ^d workbooks, practice making large dlagranns ^"i^ ^blackboard 
pract^e Sng materials like th^ minicomputer, solve problenns In the lessons, and 
share ideas and problem dilutions with one another. 

The primary workshop agenda is shown- In Figure 3, next page. 
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MT 4 


DAY S 




Ct— MlaHow m Ike 
Nlnicoiipiiltr 




illfiUw^tor 
fof-or-Mtr 


njoUoMiKiler 

Coir 


inlrpdvcUoii ti 
SlrlMft 


iilliliif Arrw 


Mfvfiiiif 
ttfhfcoivtflffr 


IntrwficlfM lo 

\ 


docliMfi 


InlHMltfCltiii li tSm 


Ntfatlv* MMrt 


iittctl^ Slirlit 
Nifii-colaiUfiw'ft 


A SobtrKlloii 
Alforltin 


Olvlsdrt 


liitHa^tloii ti 


: 


Tilt SfrliM-CBV 




Thf _Slrlii9_Gii!« 
with RuMberf 






A NulttfllCAtlon 
RoUtloA 


CoMpotlllofi of 
HulllpHcallofi 
FofKlfont 




iHlrotfoctfOM. tt 

teltcMvt Slorltft 


ftrautattont 


111 V 1 9 1 r TQU t CW» 


drier Jiimf Iiilt9«f^ 


NuUlpHcitlMi 
10 on tlic 


fro6i»lilty 




Nor 1 book t 


Nlfilcoipitir 


ltr«i md Nrlwltr 


Arrow f Icturot 


IMvlAT IrllNMlU 


Ciorclsei 

i09lc«l IhlnCrnf 






An Adillloil 
Afforlltai 


9lic«tt1oii ^ 


. CM( ifltli 

^ Nioa-<i1cuUlort 




PliciiftifMi 


liifitil ArltlMillc 




Cloftin) Discussion 






pllciillM 







rig. 3. primary workshop agenda from the Coordlnatbr^s Manual. 
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External Review of CSMP Materials 

In 1974, an external review of GSMP was cohdUcted* CSMP /tiaterlals available 
at that time were currlealam mater^ials through se^^ grade plus plans and 
sarrples from third and fourth grades^ These materials were sent td_ the five __ 
reviewers listed below, eat of a • group Vof seventeen people recommended by the 
Mathematical A^oeiatlon of America for this task. 

- - — ' /■ . • .". . ■ 

Professor Shirley Hill- ; 

University of Missouri at Kansas City 

Professor Dan E. Christie 
Bowdoln edllege 

Professor Leonard Glllman ; 
University of Texas at Austin i 

Professor George Springer ^ ^ • _ ' 

Indiana University 

Prbfessor Sherman Stein 

University of California at Davis - ' • . 

Reviewers were asked to evaluate the "soundne^ and ^a^ the mater- 

.lals" and "the relevance of the mathematical content." A summary of the 
fjve reviews, prepared by one of the reviewers. Dr. Shirley Hill, Is given in 
Appendix H. Evaluation Report 1-A-2 gives all the reviews in full, rvtost _ ^ 
reviewers were favorably Impressed, as the following sammiarizlhg quotes show: 

•It should be stated at the outlet that the CSMP materials which I have 
examined are Impressive." > 

•On tialance, I find the materials very impre^ive." ' 

••On the whole I am imprefeed by the CSMP materials." 

••The authors have certainly done some good things^ but their pins may 
offset by other Innovatiore which. In rhy djDihidhi should be dropped." 

••My opinion b that it is indeed ••rndre of the same" (though) most of .it is 
more skillfully written than the SMSG materials." 

Reviewers geher^ily lik the early ihclusidh of probability and the rr^terials on 
relations and functions, grapHing ahd arrow diagrams^ and cq^mbinatorlcs. On the 
other hcnd all were negative-; toward the minicomputer, as the following CMOtes 
show: _ . . r . ■ 

"a horrible aberration" . : 

"a disaster of the first magnitude" ^ ^ 

"it represents a diversion rather, than a step forward'^ 

"seems a bit of a gamble and the Investment Is great^^ 

••I wonder whether the investment in Minicomputer ^ills really pays off 
adequately in understanding" 

■. .. ./ _ _ * 

Q ' " •.. 30 40 
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CSMP Is a dramatic currlcular Inndvatldh, During Its development^ cohselous 
decIsIoTES were made about elementary school mathematics. The most Important 
of these were the following: 

Mathematically InTDortant Ideas should be Introduced to 'ciilldreh^ 

often. ^ The concepts of set and relation should have a pre-eminent place In 

the currlculim. 

Mathematically rich problem solving activities should be prominent aid 
shGuld_ generate topics^ guide content sequencing, and provide computation 
practice. 

The curriculum should be organized in a spiral with Integration of different 
topics from day to day. 

Training for teaching CSM^^^ be made available to teschers es should 

a set Of highly detailed lesson plans. 

These bejiefs were trans^^ Integrity Into the eventual cUr- " 

riculum materials and resjlted In a cu distinctive features. 

Each of these features was a re^spqnse to some aspe^^^ educatldn 
that many mathematics educators believed to be v/eaknesses_ In traditional instruc- 
tion. These are outlined below In what might be called "the case for CSMP*. 

1. Authoritative mathematics education groups^ then and now,^ have recommended 
that new content ajch as probability and statistics be Introduced Into the 
curriculum. 

eSMP introduces a considerable amount of new content, especial ly^in the 
Intermediate grades. Most topics are introduced in ^ i^ormal jvay, with 
en-phasls bh developing teacher-led situations, and contain prbce^es found In 
hew content areas, such as linear programming, cornbinatorlcs, probability 
and statistics. 



2. It Is generally agreed that arithmetic skill development should be based on an 
(jiderstahding the proce^es,_thus making for better recall later. 

CSMP presents numerical skliJs and concepts la a slIgKtly different sequence 
from traditlbhal programs. The concept of mUltlplIcatlGn Is Introduced 
earlier than UsUal, as are decimals, frictions and negative numbers^ Ori" the 
dthef ha-id, many df the skUl_ algorithms^ subtraetlpn 
with bbrrdwlng, adding fractions and multl-digllSf^hiplicatioh are devefSped 
rr.dre sldwly. Mastery df these skills Is hot Intended to occur until somewhat 
later In the curriculum. ' . 

3. Higher order thinking ^lUs end problem solving In general are hard to develop 
and teachers generally are not well prepared to teach them. Hence, they 

are seldom taught. 

y 

CSMP is fUled with mathem^ vihlch are rich In possibijities 

for good thinking and problem solving. 



Recent tsnE-spbhsdraj r«earch has indicated that t_e^her-led Instroction WhI* 
actively engages students may bg more effective tftan assignment of 
individual woik to stadehtSi 

The CSMF> lesons extend the length of time riarn^ly- spenl by Jeachers 
v^rking with the whole class, and reduce the Ume students spend on 
individual woik. 

MTOt elementary rnathe^^^^ teachers have little formal mathematlc 
education beyond a year or two in hl^ school. 

CSMP h^ exterelve training programs aid materials for torric^ trainers, , 
local coordinators and cliassrobiti teachers. 

Many traditional p-bgrarre devote long blpd<s of time to a ^ngle toplc^a^^^ 
^ the moltlplleatlort algorithm^ betore prjKeedIng to Uie next ^block. ^T^^ 
bores students, r«ulUhg in less posiUve attitudes towards mathemaUcs Tn _ 
the upper elementary grades when this rote development Is at Its pe^. 
In Edition, miatherhatics becomes perceived £b a set of dfe^nted, tnrelated 
topics. 

eSMP tses a spiral approach In which a topjc b taught one (tey but then^ 
left for a we* or two and In which the^me concept reappears briefly In 
several eohtexts C3ver a long period of time. Consequently, there are Tew 
points In the sequence at which mastery Js_ retjulred, there is less fSes^e 
on students ^d the sequence of varied lessons Is more Interesting to them. 

Many students entpr school with very limited verbal sRUls arid^consec^jently 
have trouble understanding new mathematlc ecricepts. _ 

eSMP uses various representatlohal 'qanguages" which are Ssle to convey 
rather complicated mathematical concepts, relationships and patterns ti , 
simple ways. This reduces the verbal load wi studehtsj fewer techrdcal worcte 
are heeded ^d Ideas that are difficult to explain verbally can be IntroAjced 
earlier. 

Mathematics education^cxjps have called for a reiXicUon In the Njge 
investment of time spent by students In learning computatlai d<ms, for 
exarrple, the months of student Ume needed to learn Icrig^ division In an age 
Of universally available calculators. National assessment data show that 
corrputation skilb are being maintained far better than application skills. 

In CSMP, this investment of Ume is delibetately reduced, parUcularly oh the 
long algorithms, leaving more Ume available for other topics. 

Problem solving skills are notoriously hard to teach. Many tea*ers^ tho^^ 
willing, have not learned the basic question^asklng techniques that should be 
used In attacking a mathemaUcal problem with a group of students. 

CSMP provides very detailed lesson guides obtaining sample "scripts" where 
good questloh-asklhg techniques are highlighted. 

I. Traditlohal student materials are boring, and often filled with repeUtlve drill 
and practice of computation ^ills. ■ 

eSMPs student workbooks are attractive, colorful amusing, flrey 
provide ah Interesting v#irlety of problems that students c* solve dIrecUy on 
the workbook page. ^ 
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In any currreulum development of the scope and vision of CSMP, h^ decisions 
must be made about cbrnprlslng tfie Integrity of ttie program in^rder to Increase 
the attraetivene^ and_marketabiiity of the product. Ttie pr(*lem was wel^ 
ten years ago by one of the CSIVP External Reviewers (see pcevious section): 

"iiiih order to »stalh a grcijp of autho^^dver the years of^ and 
testing such a giganUc endeavor, the 1^^^ the groyp must ^staln an 

espHt de e^^ his colleagues that 

borders on the ecstjitic. Sudi enthusla^ Is necessary^ and It Is dangerous. 

The group rriust ze^cxjsly believe h ^e uniqueness and value of Its 
'ereatibn, yet keep an open mind. It must blend religious dedication with 
. selentlfie neutrality." 

Whether or riot GSMP succeeded in mairitalriirig this delicate ;balance ls^en to 
cyjiestlbh. At Jeast one reviewer thought not: "It (e^MF5[ has lb own private 
religion, cbrriplete with rituals, whleh often become^ (*s«sl^^ 
an extreme arid mlribrity vlew,^ but the uncbrrprbmhing starx:e^ 
did Result In a product which was viewed by some educators as too radically 
different. No bthe^^^ eurrieulum has such a detailed arid extensive Teacher's 
Guide, iritroduees mSiy topics at as early sn age (fbr exariiple, decima% 
multiplication, negative riuriibers), makes such exterisive cse of representational 
devices, devotes ^ nriuch time to probability arid geometry, has ^ "loose" a 
spiral as GSMP^ spiral orgariizatidri of ebriterit, arid devotes little time to rote 
coriputatiorial sklll^ and algorithms as GSMP. 

Each of GSMPs distinctive features^ desirable though they were thdugrit to be by 
most rratheitiatlcs educators^ created prbtJlerins in one way or another for districts 
wishing to Implemerit GSMP. In addltibh, although the perceived weaknesses In 
traditional mathematics Iristructlbri have continued td_ exist during GSMPs Idrig 
development^ the context in which the prpgram wee ImjDlemerited changed 
cont^ually. At the retidnal levels there ls_a long list of factors which have 
chatiged the way school districts operate. The list includes: 

the move toward mastery learning^ 



Increased use of computers, 



an emerging consideration of teacher accountability, 



the recent re-examlnatfon of American education, 

the growing number of state and locally mandated tests, 



the national shortage of mathematics teachers, ^ 

iricre^ed financial pre^ure on most school districts, ' 

'__ ^ 

changes In textbook adoptibri procedures, 

the push fbr better problem sblvlrig by profe^ibrial teacher organlzatlbris, and 
the emergence of the National Diffusion Network. 



Each of them altered sbrhewhat the rules of the (GSMP Implemerifeatlbri) game; 
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This chapter will describe CSMPs implementation and how the characteristics of 
the prdgrarri arid decisions. by the adopting sites affected the success of the_ 
program. The implementation of GSMP will be presented chronologically from 
adoption onwards, concluding with the experiences and reactions of teachers. 

Before teginning a chronological description, it will be tseful, as an overview, to 
consider the relationships, amidng three different aspects of the implementation 
process^ and how these effect^ what eventually takes place in classrooms. 

1. Program Requrremehts, CSMP has been implemented, in ^^^m different ways* 
The stated requirements were often cbmprbmised in practice, but there are four 
considerations that any adopting site mUst attend to: 



Costs of materials. Start-up costs for CSMP jar e sli^tly 
higher than for other programis because of the extensive 
teacher materials, but _ar_e well within the hbrmal range. 
Maintenance costs for CSMP through third grade are roughly 
comparable to other programs; both Lse ccMlsUmable students 
materials. However, beyond third grade CSMP_ continues to 
Lse consumable materials at a cost of about $7.00 per 
student per year. This is considerably rhdre than other 
programs using textbddks which last several years. 



Teacher training. Although a few teachers were capable of 
learning the program at the same time as their students^ it - 
was necessary for the districts to establish training 
programis. Coordinators had to be trained at CSMP work- 
shops, and teacher training required either direct stipends for 
summer training or paym^^^ teachers if training 

occurred during the school year. In some districts, pro- 
fessional development days were available, thus reducing 
training costs. Personnel were needed to conduct the initial 
training and to assist teachers when they returned to the 
classroom, in succeeding years, training had to be extended 
as new teachers joined the ctistriet and as new grades or 
schools began the program. 

Program) managemient. In addition to overseeing or conducting 
teacher training, the local coordinator was also responsible 
for ordering and distributing materials, describing the program 
to district staff and parents, troubleshooting in areas such as 
testing and funding, and planning further implementation of 
the program. 

CSMP pedagogical characteristics. The distinctive features of 
CSMP, summarized at the end of the last chapter, all had 
ramifications for adbpting districts. They, made CSMP dif- 
ferent from -what districts were used to in a mathematics 
program. . Of course, it was In the classroom that these 
characteristics had thejr rhbst dramiatic effects, but because 
there are so many chatiiterlstlcs and they are. so 
distinctive, they also affected events at the dlsETTct level. 
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2 Local Se tting . There were some relatively fixed cdhdltlbhs at eah site at 
the Ume of Implementation; Size and Idcatidh (3f the district^ average class 
size, and type of student population had some effect on quality of Implementa- 
Udh. Some less clearly defined factors also affected the prograiU ajch as the 
fble of bullcfing principals and the district's reasons for adopting CSMP. But In . s 
retrospect, existing local ^i^itlons had a relatively smal^l effect on the program, 
except for two factors Which were very Important .to the program's success: the 
existence of a skilled and influenUarcoordlnator tor the program at the district- 
level and the availability of continued funding su^ort for the program. This 
second factbr was often a reajlt of the first. 

— ^ 

3. Lbcal Decisio ns aid Events. The way_ a district chose to Inclement CSMP 
and the way It dealt with Cj^MPs special eJiaracteristips, i.e., decisibns made 
when adoWng and Implementing the program, largely determined how successfully . 
the program was Implemented In a district. Some of the local decisions con- 
cerned how to respond to general district events which cbUld affect the prograrTi 
such as a change in the testing programi. 

4. Classroom Effects. There was a surprising cbnsistency in teacher reactions to 
CSMP regardless of grade level, teaching experience, ability of studentsj and pre- 
service training. For example, a significant mfrwrlty of teachers thou^it the 
program was less appropriate for low ability students, primarily because of its 
de-emphasis on computational skills, but the propbrtlbn of teachers holding this 
belief seemed relatively cnaffected by these factors. However, local decisions 
and events, such as hd^ level stpport for the ptbgram, amount of trainirg pro- 
vided, accquntablllty constraints, and -pattern of adoption by grade and school had 
a significant bearing on how faithfully CSMP was taught. 

Extent of CSMP During the 1981-82 school year, the last year fq^ which 

reliable data is available, CSMP was being Us^ by about 50,000 students fai over 
IGQ school districts. - Qf these isehbbl dlstrictSi 6 were large urban districts, and 
17 were rural or smiall town. The remainder were about evenly divided between 
suburban districts and medlurn-slzaj clUes. Most districts were public school 
districts but 23 of the districts were private or parochial. 

Most of the districts used CSMP as the regular mathemiatics program, but 12 
districts csed It primarily with gifted students. In l4 districts It was a Chapter 
I programi or remiajlal program. \ > 

From the beginning of the Extended Pilot Tests in 1973-74 through 1981-82^ the 
program was u&^iin 134 Sites. Many sites have been either In the midvyest, 
especially the St. LbUls area and Michigan, Wisconsin, Illinois and ><entucky, or in 
the east, especially New York, Pennsylyania and Maryland. There have been rela- 
tively fewer sites in the west, northwest and plains states. 
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Initial ImplerneotafiiHh af fisMp ' ■ ' =• 

There were several stages in the initial implementation of eSMP adop aware^ 

ness; follow-up to awareness; decision to adopt; and strategies for first year 
implementation. 

Awareness. " 



districts learned 'about CSMP in several ways. At somie sites the matherhatics 
educators' grapevine spread the word about CSMP to local administrators or 
te^hers^ who then brougTit.it to . the attention of district decision-makers and 
lobbied for its adoption. Alternatively^ schdbl district persornel read about CSMP 
■ in educational Journals or^^thr presentations sponsored by groups like the 
National Conference of Teachers of Mathematics. Occasionally, someone who had- 
be en^ a CSMP Coordinator at one site .would move to a^^^ district; 
More recently^ after ajDprgval by the Jbirit Dissemihation "Review Panel, awareness 
was fostered through the National Diffusion Network. Adbption of CSMP by 
Chapter I sites has been attributable in large measure to NDN-sponsored aware- 
ness se^ions,sirK:e CSMP is one of the f I eligible projects in mathe- 
matles.^ ^ Q^^^ found out about the program frsrh an 
administrator in a nearby dist^ particularly true fdr ,what have been 
termed /lighthouse" si^t^^^^ or from the same speblalizad area (such 
as a feliow eoordinator of Gift^^^ of 55 cddrdiriators 
whose district star^ted using since 1978^ personal cohtact _was listed 
as the me^t popular method of findin^ out about the program (15% of the 
respondents). But eight other methods were listed by 6% to llX^'of the cqdrdi- 
natorsf surveyed: CEMREL contact, -Gifted and Talented Confe literature, 
NDN conference, university course. Chapter I conference, CSMP used in the area^ 
and CSMP-sponsored awareness workshop. 

- - - - < r • 

Fbllbw-Up. , 

When a district learned about CSMP, district personnej usually contacted either 
the CSMP staff or another district where CSfvP was already beln^ jjsed. They 
arranged to watch CSMP being taught, interviewed teachers and administrators, 

reviewed curriculum niaterials,. and learned about the adoption-training- 

irrplementatlon process. Dcc^Ionally, §ri interested school district v^uld request 
a CSMP staff member to visit the site and conduct an awareness session for 
school personnel^ bdard.jTierribers, and even parents. Alternatively^ district 
personnel visited CEMREL in St. Louis arid discussed the program) I with CSMP 
staff. i : 



The presence of nearby CSMP sites was very helpfui fdr pr ospe ctive adopters. 
Adoptioris ill the first few years were sufficiently far-fluhgHi|t districts in nnany 
regions of the country could mjore conveniently 'visit, a relatlvfly nearby site and 
see the_ program in action rather than travellr§ to^CEMREL.^ At_ certain "light- 
house" sites, coordinators were so convin of CSMPs value as 3 mathematics, . 
progran^[ that they took the initiative I^^^ persuading nelghbdrlhg school districts *tb 
watch it being taught, to adopt it and to push for its Implementatlbh. 

Figur^e 4 sHows t^^^^ as well as the sites 

which adopted the program based on visits to those sites. * 
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Fig. 4. Distribution of "LJghthouse" sites ( | 5 
' and ajtjsequent adopters ( • ) 



The mret eommoh reason given for 'deciding to use CSMP was dissatisfaction with 
the present curriculum on the part of a.'mathematics sc^jervlsor or other^ district^ 
personnel. A lack of materials for teaching problem solving or thinking *IllS| and 
the consequent dreary, emphasis bn corrrputatlonal skills, were eit©j as weajcne^es 
in thU'r present program. Hence* the di^teiled CSMP Teacher's Guides, with their 
heavy emphasis cxi the discovery approach and ^ on question-asking techniques, were 
parUeularly attractive to these eduC^tSrs. Visits to existing sites, where they 
could observe- students' responses to ' the materials, were often persuasive. Many 
distriets were looking specifically for a math program for either gifted students 
or Chapter I students. Addption of CSMP by Chapter ! schools has Ircreas^d^^ 
recently attributable largely , to heightened awareness of the program tttou^ the 
National Diffusion Network. Gifted sites chose CSMP because it provicfes the 
type of problem sdlvlhg deemed appropriate for higher ability students and it _ ^ 
contains more mathematics and more different topics In mathematics than most - 
eommiercially available projects. 

a 

But oeeasiohally ulterior moU<es were prominent: 

* a desire to be innovative and make ch^ge for ehahge sake when fed^ 

era! or state dollars were available to support the start of the pro- 
grai^n, with no long range goal of totalxiocal financial respbhsibility. 

ah opportunity to provide badly needed general miathemaUcs traihing for 
teachers which might Improve instruction regardless of eventual CSMP 
implemientatlbn. ' . " , 

a desire to raise test scorei' in general. ° 

the appeal, for kindergarten and first grade teachers, of CSMP's 
■ manipulatives, stories and games. „' : 

the availability, to programs _for giftelj students, of genuinely challenging 
matt.erhatics without the need for acceleration through grade levels. 
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To get eSfs/jP adopted, foor^^^^^^ first had to persuade the school admlni^ 

stratlon ancfc/or school board _ to try out the prograhn. This meant addressing two 
primary Issues: how to pay for thexprogram arid how to evala&te it (at le^t 
informally) after some period of trial. At the same time, eddrdinatbfs had to 
persuade school principals and teac|?ier^ to i^e the program. They ceed several 
methods: active ^par^clpatlon by teachers and principals in the adoption decision, 
connplete voluntarism, gentle arm twisting, and administrative d^ree. 

In order to begin cslng CSMP, a school district had to sign a M^mhrghHgm of 
Understapdlpg with CEMREL. In this nneniorandum the district formally named 
ICS coordinator and agreed to provide CSMP teachers with the reeommended 
amount of training. 

Ihitlat ^ftDplementation-3trategIes, 

Selecting G SMP ei a s s es School, districts did not uspally begin i^ing GSMP at all 

since it was difficult for students to plunge rl^t Into 
the CSIvp curriculum without previous experience, especially In tllg Upper, grades. 
The most cbmmm starting pointe were k-1 and_ K^2, and occasldhally K-3. It 
was also unusual for a district to begin us[ng the program at 'all schools - at the 
same time,, unless It was a one-school dbtrlct. To begln_ wlth^ juch sn under- 
taking wbjjld have required a massive tralnjilg effort by district persdnnel with no 
previous GSM^» experience. In addition, districts feU they needed time to get the 
Inevitable bu^ but of the program, get It publicized within tt?e district, and find 
out how students and teachers reacted to it. 

Two strategies were used*mt)st often: either select a judiciously chosen school 
and impiement GSMP throu^out K-1 or k-2, o? ask for volunteers in those - 
grades at two. or three schools.. These strategies were used about equally often. 
During that pilot phase, w^^ scrutinized GSMP, the coordinator encour- 

aged other teachers, other gr4de_levels ahWor other schcKDls to p'articjpate. 
SomeOmes^SMP never mibved beyond sa::ond or third grade and sometimes never 
moved beyond one or two schbbls. But in most eases, the district went from 
volinteers at the start to selection of teachers/grades/'schools at a later date. 



Whatever the start-up strategy, the Jchbbi 'Usually --bTC the eventual unit of 
inplementatlon; some schools were CSMP schbbls - all cjasses used GSMP through 
a certain grade -while other schools didn't' use .any GSMP. Gobrdihators usually 
found It iirpossible to cc3ntinue the prograjri ji a school where, |t sbrnie grade 
levelSj Sonne students did have previqus CSMP: instructidh while others, did not. If 
only a single school in a large or medium-sized district adopted CSMP, the 
program was not likely to be cqntlnued, either in that school or in the district as 
a whole^ CSMP was [Ikely to get lost amidst all the other district-wide policies 
and practices. The only exception to this pattern^ and it is a miajor exceptidh, 
was when GSMP was adopted by ^- in a parochial school system. 

There is more autonomy for individual schools In those- systems and so GSMP was 
more likely to survive as an adoption. 
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Rapid Implemehtatkiri Sbme school districts decided to. start the program in all 
cTass es K-3{ ' T<:^zrforT< -5 of one or more schooIs> rather than beginning K-1 or 
k-2 and advancing a year at a time. Altogether^ i5«_- 20?i of CSMP districts 
used this rapid implementatioh model. In most cases, the model wap Lsed in a 
single school, sometimes the only school in the district. f 

A little more than half of these districts began K-3, the others k-4 or k-5. 
; Altogether 19 of the districts Used CSMP long enough to have a track record. 
Of these nineteen: 

nihe had a very successful implementation vs-hich eventuaily went k-S; 
^; three in single-school districts, three In multi-school districts and three 

in one school of a multi-school district, 

» : 

six either grew at a slower pace or stayed the same, 

four were LrisUccessful^ two reaching status then dropping the 
, program arid two maintaining the program on a much reduced basis. 

In cBing the rapid implementation model, coordinators chose to fxjt a very 
concentrate effort Jhtd a single year. There turnol out to be several advan- 
tages and disadvantages to. this decision. The biggest Advantage was that after, 
the first hectic year, the implementation settled dovsn with'^bnfidenee. Ma^^ of 
the uncertainties associated with start (training^ parent awarene^, resistance 
of teachers to begih-1 new program, rationalization of eSMP with district guide- 
lines) had been dvercome. Financially,^ it was sometimes advantageojs to get a 
sizeable dhe-yeaf grant for teacher training rather than smaller ambUhts for 
several years. Psycholoslcallyj it was e^ier to motivate the whole teaching staff 
together in one year; upper grade teachers were less likely to feel like outsiders 
and common problems could be attacked by all staff. 

On the other hand, the first year wa^ very hectic. The codrdihatdr had tp _be_ in 
a* position to fully support the teSIiers over the course of the year in additio_n to 
providing solid training before school started. Teachers beyond second grade had 
to use special entry modules to prepare students in the CSMP languages. There 
were no colleagues with hands-on experience whb_ cbUld provide mp_r_al_and prac- _ 
tical ajpport. Coordinators had to^be able to anticipate negative teacher reactions 
about some aspects of : the prograCTi; those which hdrmaljy grow in importance from 
grade-to-grade would be full blown without the usual warning signals from the 
lower grades. 

The rapid implementation model was a gamble^ but turned out Jp te fairly 
successful. This was probably because it" was usually undertaken only by 
coordinators who did their hohnewdrk about CSMP, worked very hai:d, and were 
able to marshal "^me special resdUrces for a year or two. 



Spec ial Adop tions;. A Lri[ciue feature of eSMP's irhplerriehtatibris history is the 
dTversity of sites which adopted the program; Several Indian Reservations adopted 
CSMP and used it with varying^ degrees of success. Aides were often called upon 
to banslate CSMPs special vocabula^^^ into the students' native language with 
sorrie degree of apparent success, teachers had mixed reactions to eSMPi How- 
ever, their jnflueflce in the CSMP decision was limited, since these schools were 
administered by the federal government and tended to be centrally operated. 

. _ . . ^ 

T|tle j skes were attracted to the CSMP curriculum because of i^s motivational 
characteristics for younger children. Thoug^i miost Title I teachers were well 
satjsfied with this aspect of CSMP, many standardized test scores did. hot 
improve. Since these test scores -play a miajor role in Title I evaluation, adoption 
has been lower at the, higher grades where motivational characteristics are less 
persuasive. 

Where eSMP was used as a gifted program), the situation was quite different. 
Standardized test scores were less important as districts searched for more appr(> 
priate instruments. Teachers vvere pleased by the challehging nature of_part§ df 
the curriculum) and its emphasis oh problem solving. Coordinators saw CSMP as 
one of the few alternatives to acceleration. ' - 

In ail tKree of these special types dfv sites, CSMP costs were less crii::ial than in 
regular implemiehtatiohs because spe^ available over and above the 

usual textbook allotmients. Admihistratidn of the program was easier because it 
was part of a centrally administered division. 

Training CSM P Te achers. The original iliemorandum of Understand^ 
CSMP tea::hers_ to _ be provided with a certain amiount of training, -royghly a week 
for teachers of primary grades and two weeks at the intermediate level. Later 
these numbers were reduced to between one and five day s, depending on grade 
level. Schools tried to accomplish this in one of two w^^^ a solid block of time 
in the preceding summer or one or two days before s:hool plus odd days or 
afternoons during the year. In either case it was^, difficult for most districts to 
achieve the recommenc|Bd amounts of time; well over h^If of all CSMP teachers 
did not receive the mandated levels of training. In many school distri^ 
especially the larger ones^ there were very precisely defined union agreemients 
about what teachers could and could not be asked to do outside of the regular 
teaching hours (i.e. 8:30 - 3:00)^ and coordinators had to grab an hour here or 
there with a few teachers as best they could. At other sites, many teachers 
willingly gave up part of their sum^mer vacation for an unpaid wed< of training. 
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Many districts^ especially in the metropolitan St; toais area^. were able ^ take 
advahtage biT CSMP's trainrng program and sent a few of their teachers to a St. 
bbais Werkshbp, A helpful factor in some sites was the presence of ^an^e^xper- 
ienced trainer in the area. Since the :cSMP-CEMREt staff could not visit ?11 
potential sites and cojld rot train all potential adopters, unofficial "turr*:ey 
trainers trained at CENIREL were able to train teachers in their region, The^ 
distribution of turnkey trainers and the sites they visited is shown irt-Figure 5. 




Fig. 5. Dis'trlbution of CSMP turnkey trainers (* ) 
and adopting sites ( • ) 

Fundlna. Only about one-third of the districts supported the progranr from the 
%tart en tirely with regular district flrids. Special funding of one tend or another 
. - state local or federal -wse tsually used to start the program. The mret _ 
commca^ support.xused in about one-third of th-e-gTstricts, was through fed?ral^ 
Title IV assistance. Other sources gf support were state or local grants, usually 
for gifted or remedial programs, and federal Basic Skills grants. In any^^case, 
thesi special funds were not intended to tie permanent endowments for the 
program. 

Problerns associated with funding Wer* related to several other factors S^m 
districts did not anticipate the true costs Of CSMP - costs asaciated with ^tirst 
timi Sf m-goln^ teacher training,- and costs associated with replacement of ^ 
"tuderP c^sumlble materials. For some districts, the problem of anticipating 
budoetS waT^^^^ by the fact that ftiey were initially attracted to CSMP 

for ^Jort term TeSons rather than to meet long term goals. Since "sof t" money 
was available, several school districts elected, to give CSMP a try knowing that 
The te£her training component v^uld provide needed mathen|tics lnservice 
rllnirS A few districts had faffen Into a pattern of ^d°Pti^ one or more 
^novations each year in a fairly hit or miss fSshlon. f .^hose dht ct| 05MP 
•was lust one of many curriculum programs tried, all of _ which couldn t be afforded 
r the same time for very long. For all ^i^tncts, funding became a ^^^^ 
important consideration with the increasing financial pressure on schools that 
in the late I97e's. • 
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Coatinuing Imp lementatidh ' .. 

Decisidri IMaklng_J^ter Year One ' 

buring the first year that CSMP materials were used in a district, the program, 
was^the object of careful scrutin£ and Doordinatdrs were on the spot; For almost 
|1J districts this first year went quite successfuJly and was helped by several 
factors. Initial implementation vs?as most often, in grades F<-2, which turned out to 
be the grades in which the program was bes|, liked by teachers. Tethers and 
■ schools either volunteered or were selected because of their probable receptivity 
to a program liRe GSMP. Money was often available from special funds for this 
pilot activity.:: Because the pilot was usually In only a few d'asses, the coordin- 
ators were able to monitor the program and help teachers on an Individual basis. 
Participants had a natural enthusiasm for tjelng part their district's lead group in 
an exciting, innovative program. , 

In spite of Its early succes, ^y the end of the first year most cgdrdinatbrs came 
to the realization that district-wide Implementation would take more than a' year ' 
or two. The logistics of teacher training were formidable. Implementing the ' 
program at more than one grade level at a tiqve was difficult. ^Material costs 



were likely to be a problem ''without special fends which might not continue to be 
available. ' 

At the same time some disturbing features began to appear, each of them 
• destined to be a bigger nuisance with each saccessive grade level. The program 
required more bookkeeping than anticipated; materials were complicated to order 
shipments had to be checked and distributed, and orders were late in arriving. ' 
At the classroom level, there was a bewildering array of materials. Teacher's 
GuIdeSj workbooks, worksheets, demonstration materials, and manlpulatives had to. 
be stored and kept track of. As teachers came and went, there was a continual:' 
need for new teachers to receive teacher training. Most teachers vvere not able ' 
to complete the, schedule of lessons in the required time. F'ressures were 
developir^ in some districts for the program to prove itself on the district 
standardized tests while, at the same time, some, teachets complained about the 
lack of drill and practice and began sUpplemehtlng tbe program. A few teachers 
complained about the program not being gdod for lower ability stadents who 
couldn't follow sorn^ of the lessons^ and didn't seemN^o be getting proficient at 
the eSMP languages. Some teachers did "not like the spiral approach. 

everall the program was verj' well liked in the early grades and most of the 
teachers who made these complaints were nevertheless strong supporters of 
eSMP. But with a "second,- wave" of teachers to be intrpduced to the program, 
the diffieuities worsened and: sometimes proved Insurmduhtable. Those teachers, 
often less venturesome than the first wave of teachers, and dfteh less confident 
about their mathematical abilities, were reluctant to volunteer (or be 
volunteered). 

• ' \ 

In a fevy sites, these problems, and insufficient enthusiasm for the prdgram, were 
enough for ijne district ,to put CSMP expansion on hold or even drop it. But 
most often, ^coordinators Marted to. plan for an expanded implementation. Given 
the warning signals described above, they planned for a rather modest expansion, 
i.e., bringing another school or two into the progranrij consolidating it in the pilot 
school, and starting a few teachers at the next grade level with experienced 
CSMP students. _ ■ , 

t 
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Often; after about the seciDhd year of implementation, the school district adminis- 
tration began to look earefully at the program., Up to this pojnt, the adminis- 
tration cBually had been content to approve a gradually increasjng pilot stage. Butk, 
as the implemientation §bt. larger, more visible,- and inevitably controversial^ senior 
administrators began to think about long range plans. There were four crucial v 
cdhsideratlons for the 'admlhlstratlon: t^st data became available, teachers' reac- 
tions were formally sought, total program costs could be falrlj well projected, 
and the scope of the required teacher training effort could be . determined. 

These factors were judged In light of the present district matliematics^ cur- 
riculum. Obviously eSMP easts and teacher tracing demands were higher ^ that 
unl^ess teS data or teacher reaction indicated an improvement over the project 
curriculum, the administration was lIRely to be lukewarm to further expansion. 

Typical Ratter n s of Chang e. 

-Once districts had decided to adopt GSMP and had decided on finding, training^ 
and initial Implementation, it became their respohsibillty to continue It, monitor 
it yid make decisions ^concerning Its implementation and continuation. 

CSMP had at least tPiree major patterns of addptidrvtbntinuatlon: 

1. CSMP was adopted for a year or two, after a very limited trial, rid .:. 
then dropped. Often the adoptioh was bh a limited basis such as at ' ; 

= . only one grade level br In only two br three classes. 

2. CSMP was adopted for several, years D-10+) but. there was an "etto and 
flow" phenomenon "associated with Its Implemehtatlbn. From year to 
year the number of participating schobls/grades/classrdoms fluctuated 
with no stable p'attern of consolidation br dlsperslbh. 

3. CSMP was adopted^ for several years (3-10+) and was successively adop- 
ted at each grade level and In more classrooms and* schcols each year. 

fable 3 summarizes,^ for each y&8r> the number bL districts which begn uslrg the 
program and how long they continued to me it. The lower diagonal represents 
tt^e numbers of districts contlnuind" to cee the prbgram in- 1981-82. . 

Table 3 

Length of Adoptiein by AdbfjUon Year 

Year of loJUai Adoption 



1973- 1974- 1975- 1976- 1977- 1978- 1?79: 19K)- 1981- 

74 75 76 77 76 79 80 81 82 

^ _ A. 

fsijTt). of ne^ sites 2$ 6 15 8 3 5 22 22 

fstnt). of these sites ' , 

cdritlriulng for: : , ri n i 5^ 

1 vear 3 1 6 0 1 0 0 ^ 



1 year 3 i 6 ^ 1 ^ i o\ 

2 years 9 1 4 0 - Q 0 > 21 

3 years 



10 1 10 1 19 

3 0 0 2 0 5 

0 0 0 1 2 

0 1-14 



4 years 

5 years 

6 years 

7 years 0 0 . .3 
IH years 3 3 • * ' 

»y /ears 9 >, 
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A total of 29 sites ased esF^ for only a yea^^^ two before dropping ]tj l5 sites 
dropped It Mmetlme aft^^^ the^ second year^ and 44 sites were sU^^^ using CSMi=> 
after at least three ye ars^ ^^T^^ table Indicates that most districts who began 
using the progia^^ 1976-77 continued to use it In 1981-82; more recent data 

corroborates iHs finding. 

Table 4 tells only part of the story because each year me districts were 
dropping CSMP, othjer districts were adopting 1 1^ and still others were maintaining 
it. Tat5le 4 shows the r^iffiber of sites dropping and adding each year. The 
percentage of sites continuing is also shown. 



Table 4 

Chaiges in the Number of CSMP Sites^^by Year 





Fron previous yeir: 








Year 


» sites 


1 sites 


ft r cent 


sites 


Total 




continuing dropping 


contlnuatldi 














28 , 


28 


1975-75 


25 




■ v^86 


6 


31 


1975-76 


21 


Id 


66 , 




36 


1976-77 


28 


8 


78 


a 


36 


1977-78 


29 


7 


61 


3 


32 


1978-79 


30 


2 


94 


5 


35 


1979-80 


54 


1 


97 




56 


1980-81 


53 


3 


95 




^5 


1981-82 


65 


Id 


87 


23 


88 



After six years of fairly stable usage (always between 28 and 36 districts)^ there 
has been a steady increase, begihhlrig in 1979-80, in the number of districts using 

GSMP, ' , ' ; . ^ 

The fluctuations in adoptions from year ^o year are attributable to several 
factors. Shifts in federal prlorLtles and directives for educational labdratdrles 
affected the intensity, of CEMREL dissemination.ef forts as well as; the distribution 
of sites, within. CEMREL, the acqujsitloh of staff with specific Tesp^^^ for 
dissemination of program Information increased the Ihtehsity of addjDtioh efforts 
and the provision for program continuation. CTutslde of CEMREL, the .establish- -> 
ment of the National Diffusion Network ilSJDN) facilitated awaren of CSMP ah<^.f^^^^ 
provided funds for adoption.* Specif n^ionie's. Title IV-C for -example, served as an' 
Indacement for many sites to review their programs and select innovative pro- 
grams designed to meet special needs. • 

CEMREL's own mandate frorh the government also affected adoptions. Over the 
years, the governrrient first counseled CEMREL to look for a national audience 
for the program, then to fpci^ on attracting large urban school :Systems to the 
program, and then to turn attention to • potential adopters, within- the j_t^^ 
region defined for CEMREL by the National Institute of Education, ^CliN^EU's 
funding agency. These shifts in focus affected thg dissehnlnatidh staff's 'gmphasls 
on adoption' and irriplementatidn. , 
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Imglernehtati bh by Grade Level 

The program was irtlplemented more frequently, at the primary level. Table 5 
shows the number of sites which implemented It at each grade level; 

Table 5 _ __ 

Ncrhber of Sites By Grade and By Year 





K 


1 


2 


3 


t\ 
H 




£ 


1973- 74 - 

1974- 75 

1975- 76 


29 
28 
31 


• 31 
29 
29 


18 
24 


18 


s 






1976- 77 

1977- 78 

1978- 79 


24 

25 
30 


29 
31 
34 


27 
28 
32 


23 
27 
29 


16 

22 
22 


12 . 
15 


7 


1979- 80 

1980- 81 

1981- 82 


36 
49 
58 


46 
51 
60 


42 

46 : 
58 


36 
40 
48 


25 
27 
32 


17 
19 
25 


12 
16 
17 



The table shows that CSMP implementation declined after third^grade. There 
may be several reasons fOr this pattern. Since some sites adopted a ^radug 
Tppr^ch to implementation, and elected to begin ^ing it at Kindergarten the 
first year first grade the next year, and so on, it would take a few years for 
CSMP to%iH< its way up through the grades. But this can't be the onjy re^on, 
since CSMP^bften was^nm used beyond third or fourth grade in sites where there 
was ample time for this ' to happen. 

One factor in this lack Of Use in the higher grades was_^^^^^^^^ 

uDoer elementary ■•grades cost more than schools are used -to spending in those . 
g?Ses AnotThei^^^ was training, which is lengthier for the upper elementa^ 
o ades the mathematics is more difficult and novel at higher grade levels 

Ind so ttafhers may have been reluctant to tackle the relatively difficult lessons. 
The physical materials (student booklets^and Teacher's Guides) are also mo^^^^ 
voluminous after third grade. In some districts, there is a very- real d fference 
be ween What is vlewed%s Wopriate:^ mathematics for K^^ . 
as appropriate for 4-6. in those districts, many teachers beyond grade 3 djdn t ^ 
view CSMP as "real" math; activities, games and mathemaUcal Jtories were rio 
longer Is acceptable In the business of learning mathematics. Finally, in dist^cts 
'where there was a grade-by-grade adoption strategy, an "old-boy" network some- 
times developed among teachers. Upper level teachers became increasingly ^ 
solated from the interchanges among CSMP teachers at theJower grade levels, 
hence, resistant, to implementing it when then- turn came. By t^en, ^^any^^ad 
adopted a defensive stance vis-a-vis "their" math program and^ efforts^to recru.t 
them for CSMP may have been less vigorous than they were for teachers at 
lower grades. 

Adapta tions 

Adaptations at the district level took several forms. Some adaptations of the 
program took place even before the first implementation; districtsj<new in 
advance that It would use CSMP in special ways, for example, with gifted 
students or as a sopplen-.eht to a regular textbook. 
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But most adaptations occorred after one or two year's experience with the cur- 
riedldrh and as asage was expanding. Below. Is a list of some of the cdmmoh . 
adaptations that, were made on a formal basis by districts^ or by a school within 
a district. Some: of them were only extensions or additions to the programs; 
others changed It cbhsiderabiyi 

) 

Responsibility for various coordinator tasks were delegated; for example, 
someone else might be responsible for seme of the schools^ or one 
person had responsibility for training and another for ordering 
materials. 

The length of the. mathernatlcs class was officially extended to take 
Into : account the longer GSMP lessons and/or the heed to provide 
supplemental instruction In cdmjDijtatloh. 

Various materials were xerdxM^Ih order to reduce costs. 

Lists of ihstructlohal objectives that were considered Important but not 
covered fully enough In CSMP were prepared for teachers^ whw were 
then responsible^ for their students' attainment of those objectives. 



Grading standards for CSMP worksheets _were established^ with remedia- 
tion to be provided for students who did not reach the standard. 

Students within a school were a^^^ to CSMR on the basis of parent 
decision or ability. In the latter case, CSMP became the upper track 
program. 

The schedule of jessons in the Teacher's Guide was cjianged, e^^ by 
deleting certain blocks of lessons or by college tjng tqi^ther groups of 
spread-out lessons Into a single^ block, i.e., moderating CSMPs spiral 
approach. 

Jeachers were asslg^ as teams, with tearn members teaching either ^. 
the upper or lower ability students of a pair of classes or teaching 
certain lessons to both classes. 

eSMP tests were developed for periodle administration by ail teachers, 
to be used as progress eheeks or for grading purposes. 

Teacher training programs were adapted In every conceivable way. 

Special miaterials and workshop fbrmiats weire dev^bped fbr use with 
parents. 

Many of these adaptations were marie in bther districts by ihdivIduaL teachers^ 
but nWer as sueeessfully as when done bh ah official basis. Most of the chants 
described above were made in districts where CSMP went very successfUllyj they ^ 
were sensible decisions made In reaction to cbhcerhs bf teacher arid administra- 
tors who liked the prbgrami, and thgy strengthened the program's standing in the 
distrieti 

Failihg to respond cbhstructiyely to cdhcerns about the program^ or allowing a 
laissez-faire attitude toward teachers' individual (and sometimes kliosyntratic) 
adaptations, usually meant trctible Jater as the program ca rne to be implemented 
in a less standardized way. Within limits. It was better to admit the problem and 
solve it thai to ignore it. 
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The CSMP Cdbrdihatdr 



kinds of (^oordlnatQrs 

In districts where CSMP was successful^ the coordinators were a rnajor factor 
because of their positions in the district^ their belief in CSMP's goals and their 
degree of active SfDdhsorshlfD. Active sponsorship flowed from a firm belief In 
eSMPs goals, and was most effective when the coordinator was well-placed In 
the district's admilhistrative hierarchy. 

□he of the key factors in the success of CSMP as a_ nAtlonal_ progra^^ 
Insistence that adopting school districts appoint a "coordinator" (i^ually a local 
administrator or teachM who assumed day-to-day responsIbUlty for the project by 
orderlhg supplies, cbhdUcting in-service and monitoring teachers as they taught 
CSMP lessons. 

Districts had different strategies in selecting coordinator^^ 

affected the prbgram at Sonne sites. The adty^tlo^ literature is full of 

case studies of_ adoptions which failed because sponsorship of a program was not , 
well placed. The CSMP exjDerlercTe supports this literat^^ In a few eases a 
willing volunteer teacher espoused t^he program, pushed for its adoption, and was 
given cddrdlhator duties but not administrative authority, in these eases, CSMP 
Iknped along^ and was eventually dropped. The samie was equally true whgn the 
principal of a school was the sponsor. It was dlffieult for the prirclpal to get 
out of his or her own school Jnto other schools, much less to effect a system- 
wide advocacy for the progrann. In contrast, a well-plaeed sponsor with district- 
wide responsibilities was a distinct advantage and in many cases protected the • 
■program when district leadership or goals changed, when standardized testing or 
accountability |5ressures mounted, or when new funding sources had to be found. 

There were four different types of eoordihators: outsiders,, teachers, administrator 
custodians and administrator sponsors. Qutslders were typically math professors 
at l^Dcal universities who volunteered to introduce CSMP to the district and 
support Jts implementation by eohducting Ih-servlee and mdhltdrln^^ classrooms. 
The^ were generally able to galvanize teachers to adopt and Implement the 

program, but they lacked the "elout" - the entree to decIsIqrHmakers aid 

sustained access to teachers - which was necessary to create a rong-terrn CSMP 
commitment by the district. If a_ school superintendent changed^ or pqllCj^ shifts 
occurred, the "outsider" wss usually hot able to protect the program. When^ a 
decision regarding CSMPs future In the district was being made, the outside 
eoordinater was not In a posltlbh to affect the decision. 

At some sites, a teacher was the catalyst for adopUpn. Aroused By a C^^ 

awarengss session or a_repdrt from a colleague In a neighbo^^^^ 

teacher would adopt CSMP in his or her own classroom or try^ to spearhead a 

buildihg/distrlct-wide adoption effort. These efforts,^ while successful; in the short 

run^ were unsuccessful in the long run. Teachers were ix)t in^ a jDOsitlb 

policy and couldn't secure fljnding needed to. sustain the program. They lacked 

sufficient mobilft^within their own building, and from their bdjdin^^ 

buildings^ to create enough momentum for CSNf^ to take hold on a large scale. 

Oh the face of It, while they might seem to be a natural source of difft^ion, 

teachers were not able to promote the program effectively. They were as 

impotent as outsiders when it came to advocating the program or protecting it in 

a district's budget. 
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Central office coordinators were more; beneficial to CSMPs Ibngg^ity-. They were 
around when funding and staffing decisions were made; they had the visibility and 
the mobility to advertise the project within the aistrict^ and they had the 
authority to monitor and critique its implementatloh. At one site where the 
program was used_ with gifted students^ the CSMP Cdbrdihatbr was also the gifted 
coordinator. According to him, CSMP survived because the implementation effort 
kept a low profile, with little publicity and few demands on teachers or 
resources. The arrival of a new superintendent created a desire to reduce the 
visibility of the program further and tiD wait for the proper time to drarrtatlze 
the program and its effects. SOj even though the teachers in regular classes and 
the local math coordinator wanted to use CSMP district-wide, the cbdrdinator*s 
reading of the situation was to take a wait and see attitude. Ah outsider Isn't 
as good at reading internal district politics and responding effectively to them). 

There were two kinds of adn^lhlstratjve coordinators. "Custodians" treated the 
program like any other project and merely carried out their duties as specified by 
the Memorandum of Understanding^ "^ponsors"^ on the other hand^ were firm 
. advocates of the program. They were LBually the one_s vvho brought the program 
Into the district^ went to bat for its adoptionj and acted as trouble shooters. 
When fixids. were low, they tried to find other ways to finance itj when teachers 
seemed to need rriore In-service they arranged for It, and when there were 
questions about the program's impact on students they wen^ out and contracted 
for evaluations so the program eould be considered on its merits. When CSMP 
was "in trouble" in a district, a sponsoring coordinator would often regard the 
difficulties as minimal while a custodial coordinator viewed the difficulties as yet 
one more obstacle to cbhtihuatibn. 

Some of these district-level cdbrdihators were miath educators first and admini- 
strators second; for others the reverse. vyas true. Being mathematically trained 
helped 9Dme to understand the ybals of the program (which vvere riDt always _ 
spelled out). They were better prepared than their less mathematically sophisti- 
cated colleagues to present the mathematical content arid precedes during in- 
service. But others who^ did not have a strong math background but vvho did 
understand the general conceptual development that CSMP alriied for, were^so 
effective sponsors. Either a strong math background^ or ah UhderstahdirQ of the 
aims aid the pedagogy to lajpport those alms^ was necessary fbr succe^ful 
coordination. Otherwise, the program was a flash in the pah at some sites. 

In 1981, eighteen coordinators w part of a series of site visits. 

Seven of then^,^ were in central office staff posfteins^ six had mathematics super- 
visory roles, three vverea^^^ t^ were classroom, teachers. Not 
one had CSMP coordjna ting as the ^le r Thus^^^ it is not surprising that three 
quarters of the coprdinatqrs reported that they^^ attended to CSMP responsibilities 
"infrequenUy"^ For some coqrdinatorSjLi^^^ constituted a second^ 
almost full-Ume job. Act^^^ the specifics of the Menioran^m of Under- 
standing, they ordered materials for the district, attended' CEf^EL's vin^service^ 
conducted district Jn-service,^ monitored classes, critiqued and demonstrated 
lessons, met with parents, and arranged for CSMP's imjDact on students to be 
evaluated; all these were in addition to their other duties such as coordinating . 
the district's gifted program or administering the curriculum division. 

ether coordinators treated CSMP as a part time responsibility and delegate most 
work. They had teachers order the materials, let the math cbordinator _9LJperyise 
the classroom teaching, recruited district research staff to gather evaluation 
data, etc. In many cases this was npt from lack of interest in the program,' but 
from lack of time to fill miuitipie roles. 
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eiassrobm visits were the m6sr c5nnmon activity undertaken by thes|_ca)rd]nators 
(aboat^5% reported this actlvlt^)^ ind evalaatle»h actWIUes pete undertaken by 
half the coordinators. Only four of the eighteen conducted train hg; the test - 

hnrnpd that resbdhslbilltv over to a turnkey trainer or others In their school 

St^ WhlS m^h" 0^^ coordinators Interviewed In 1981 had direct personal 
Involvement with CSMP and were responsible for initiating its f 0Ptl°il a";^ 
participating in training, others inherited the Job .from the previous coordfriator or 
from an Interested adv^ocate within the system but had no ownership involvement 
themselves. 

Three-quarters of the coordinators viewed themselves as ultimately responsible ^ 
decisions specific to CSMP-s day-to-day operations but ^were^not the wies making 
decisions about renewed' funding for eSMP. me majority^ df ^ije ^^'"^^^t^J^^.,^ 
reported funding the program out, of their district's operating budget. A school s 
textbook fLTd or the district's operating funds were generally used for books and 
supplies. Thus, and unless prices for materials cdhtlnued to rlse^ramatlcdly, _ 
mSt of those coordinator! thoogl^t they would be able to contln^ the program^ln 
spite of the fiscal problems facing their districts. That may be realistic, but data 
from previous years show that other sites which had adopted the program and 
Intended to continue It were not able to because of program costs. 

the intrinsic ^ merit of eSMP was often named ^ the key_ factor ^ coord^ators' 
efforts on behalf of the program. Several coordinator commented that they ^ 
were looking for a program with a problem solving orientation and eSMP met 
those requirements. Those coordlpators said CSmP was ''the best program 
available", "wa^ ahead of any other available te^", "a thinking program", and 
"not a bandwagon approach". 

The relationship between the coordinator and the bcilding principals varied 
enormously. In most sehools, principals were Influentld In adoption. dec sions,^^ 
particularly when they had spending authority for textbooks and matexia s.^ Some 
principals were Instructional leaders in their schools a^d Srpatly^ facilitated ^ 
teShers' attempts to implement the program^ This kind of act ve^ parUcIpation 
relieved coordinators of some of the day-to-day tasks that required school visits. 

In other sehools, especially large ^hools in l^arge districts, p^^^^^^ 
managerial role instead. Though they cooperated with coordln^ators in og sUc 
matters, they did not really learn much about the program. Their evahj^^^ 
the program was based mosUy ,Dn their teachers' r^a^.tions^ t^^ S ° r^f ^ 

went and how well their students performed on disthct-administered tests, i; 
this nformation convinced them of CSMP's merit, they were very supportive. 
bI sSch principals liked to run a smooth ship and differences of opinion a^ut 
eSMP on the part of their teachers caused them great concern. Many pf these_ 
p^nclpis werl ajbjected to prepare from the central office to Improve stand^^^ 
ized test scores. Not really knowing the program, and the unmeaajred learning 
that might result from it, they equated extra program cost with measurable 
• achievement gains. 

In summary, when the CSMP coordinator had a point of view that w^ ^milar to 
CSMP's . and held and continued to hold a pdsltion of responsibility In the ^ _ 
district, the program was likely to survive in that district if funding con Inued to 
bfavailaSe. in contrast, dppo-rtunlsUc adoptions, (where the reasons ine uded '-It 
Sundid Hkl a good idea" and "Money was available to do it^^^ did it") were 
likely to fade quickly. 



eoordlnator Concerns 



During a Coordinator Roundta at CEMREL 'In 1980, 26 coordinators completed 
a questionnaire In whlc^^ they rated the likely effects of \farious potential 
problenns associated with CSMP, both In their district Bn£ hypothetlcally. In other 
districts; /r- 

Events that cro^^^ cttose to define as "Ibcal" Were easily the most critlcal_ 

factor for coordinators. Such events included changing school population, test rer 
quirements, lack of^fuids or the admihistratioh's lack of knowledge about CSMP. 

Next in importance were t^he related issues of teacher training and charrge in' 
teacher phllosophj^: - 7 
too great a change in teacher behayior or philosophy, ' ^ 
not enough time or authority to traln/mbhltar teachers^ 
teacher training can't be done 'adequately, 
^ < 

followed by concerns about comjDutatlon skills: >^ \ 

instruction on connputatlon algorithms inadequate or tod delayed, ^ 
.0 lack of attention given to .computation practice. 

te^t important were logistic matters of cost and organlzatldn of materials and 
lessons: : . * 

too much time needed for lesson presentation 

organization of various materials too complicated in the schedule of 
:, lessons ^ . 

Every issue on the list was rated by coordinators as more of a problem for other 
districts In general than for their own districts^ Teacher tralnlng_lssues followed 
by computation coneerrs also topped that list aid about half of the responses to 
the five statements listed earlier for these concerns w^ere 4's or 5's, corresponding 
tespectlvely to •'High negative effect which is often decisive though sometimes 
(Dbsslble to overcome" and **Deeisive effect that eacees rejection and is not 
possible to bvercbmie". 

fhUs> one can assume that these eobrdinators believed that CSMPs teacher 
training requlremeht and low~femphasis oh computation skills would prevent the 
prbgram from achieving widespread use generailv, though they were rated as 
having only a "slight" or "moderate" effect In their own districts. 

The main cdnstralnts in teacher tralhlrig were time and money. In-Service 
education is costly and the logistics of conducting in-service for speeiil programs 
must cbmpete with other school district priorities. Not only do teachers have to 
be^paid for their in-servjce Ume, but that time has to be squeezed into (and 
often competes with) the district's plans for on-going in-service. Most districts 
allocate two or three days per year at most for in-service. During those days, 
all the in-service needs of teachers have to be met. Districts are often reluctant 
to release teachers from In-service sessions devoted to district neeefe in order to 
concentrate on special programs. 



Another constraint In training was CSMP's uniqueness as a hnathematics prbgram 
as well as the cqmplexity and sophlstlcatibn of that hnathehnatlcs. . CSMP Is. 
unlike most of the mathematics that teachers learned iri elernehtary school In 
pre-servlce training. For many teachers^ the mathematics content and the 
distinctive languages were Intimidating and contributed to teachers' reluctance to 
implement CSMP. 
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Several coordinators arlfl teachers cbrtirtiehted that a major drawback for eSMP 

was teachersi'-iriabiHt? to see "what Is. going On". In their vlew^. the workshops 

focL£ mote -^hsm -desired on individual lesson activities In the strands;- . Since many 
teachers have a restrictive definition of problem solving, thinking It to be only ^. 
the heuristics Involved in solving the usual word Jprablerris, merelj^ caJUna CSMP a 
problem solving approach to mathematics did not help t^ose teachers; 

Regarding the computition problem, teSchgrs, central staffj^parente, and _ 
coordinators at all sltfes expected CSMP students to perform at ie».t adequateJy 
on standardized tests, I.e., no decline In scores. Scores did decline oecasionally 
on corrputatfen tests, though for the most part they stayld^^ about the same or 
occasionally Improved. But a result Of "r« change" generally did more^ harm than 
good, since somp schoolboar* and superintendents then had trouble_justifying the 
Increased training and materia cost for CSMP. This effect was redoee^^ 
cases where districts cooperated with CEMREL In conductinj^ studies of student 
achievement using hon-stahdard measures more appropriate to CSMP.^ CSMP. 
students' improved Jeart^ng do thOse tests persuaded some administrators to ■. 
accept coordinator!? claims abOut the program. . ■ 

. '■ . _ ' ■,'5, • ' 

However, other aiminlstratOrs were not Irnpreased. For them, the nuFibere that 
came bick to theh^ from their own standardized testing (for example^ average^ 
percentile ranljc'-for each grade) determined their success or failure as administra- 
tors. This cohstrlcting influence of standardized tests, with its _chain of a:count- 
ability, public - schoblbOard - superintendent - principal - teadher, places in 
jeopardy any program that deviates frOm the national curriculum. 

Toqether.*local and CSMP-r elated factors were constraints that most CSMP_cc83r- 
dinators v^ere able to overcome. They learned that a successful CSMP implemen- 
tation was LBUally possible, but never automatic. 
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The CSMP Teacher and Classmam 



Data in this section edme from three sources. First, each year daring the 
Extended Pilot Tests, CSf^'F^; teachers at certain grade levels were asked to 
respond^, ^^^^ about 500 questionnaires were returned oyer 

the yearj; Prg^ortio^^^ more questidhhalres were returned from the lower grades 
vj^here the'^proaram has been available longer. The return rate was about 6036 in 
the lower grades, higher in the upper grades. Sa:ond,_ about half that number of 
teachers were^jnteryiewed. The Interviews were either ;fextenslve end wide-ranging 
when conducted locally, or briefer and more intense when Conducted during a slte^ 
visit to distant site. TT^^ observations^ were conducted throughout the 

eourse of the evalufllon. Lbcally they .were muth more extenslya, the $ame ^ 
teachers be inj^ visited frequently duriag the course of the year; :ln other sites 
they tended to be more frantic, a f^ minutes at a time. Teachers representing 
altogether about 40 school^dlstricts have -been observed and: -interviewed. 

VBackgrou nd-an4 ExpBriencte ^.: " ' ■ / ' • . 

With two kinds of e^^^^^ have been fairly typical elementary 

sehool teachers.- Year after y^ear, in comparative studies of student achievement, 
the responses of CSMP and Jsion-CSMP teachers were very similar in number of 
years of teaching experience, grade levels taught, and amount of preparation in 
hiathematies. 

□he exception often occurred w^en a district .first adopted CSMP and the 
coordinator had to develop an implementation Srategy. A common way of doing 
this was to recruit a few kindergarten and first grade teachers from one or two 
schooJs. The presence in a school of particular teachers known for their 
excellence In teaching or for their operrie^^ to a CSMP-lIke Instructional 
approach, was often a decisive factx)r In the selection of that.schopl as a pilot 
school. Thus, during, a district's firs^ year or two of the jDro^rag^-^f^^NIP teachers 
tended to Be more able and open to new ideas. Later^ as new' t^t:ners and 
grade levels started using eSMP, the overall composition ^f CSMP teachers in the 
school became more^ typical. Teachers at higher grades more^or less inherited 
the prbgram and their CSMP students, and the program became institutionalize^. 

The sec^d exception occurred in some schools where the program was ^not 

maiitored closely and was hot officially mandated by the district^ the 

mathematics prbgram in the school. It therefore became fairly essV'^fdf teachers 
to avoid teaching CSMP if they wished. Many teachers began- to teach it on a 
part-time basis and this led to one of two situations: either CSmp became 
voluntary, some teachers teacWpg It while others taught from the regular district 
textbook, (in which case the Ipxt grade's, teachers would be faced with two 
groups of students: tradltiohajl and CSMP), or else teachers traded and a teacher 
who liked CSMP would also teach it to a colleague's class while the colleague 
reciprocated in a different subject. In either case, the CSMP teaefers in those 
schools were TOt typical teachvers; their teaching style and philoso^^evidently 
agreed with CSf^P. But this laissez-faire attitude usually led to the demise of 
the program in these schools. 

% • • • 
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Teacher frahfrig 

the tfadhlng program developed tot CSMP Was designed to give coordinators and ' 
teachers a conceptaal overview of the distinctive langufMs aM content of eSMP 
as Weil as jDraetloal demdhst rations and practice In teashing the Jessons. The 
dufatidh of the training was tntehded to, be 8 hours fpr first-grade, 1<% hoars for 
second grade, 54 hours for third grades and 32 hours for fourth, fifth and sixth 
grades. eSMP reeemmehded that all training be complited before school opened 
in the falh These recd|nrnehdatibns were seldom adhered to because of local 
constraints. 

Sites had several bptidhs'for training.- Coordtiators and teachers ebdld attend 
sessions conducted annually at CEMREL. Alternatively eSMP staff members 
could sometimes visit a site aid conduct training. A third bptlbh was the ' 
provlslbh of a "turnkey" trainer who bad been trained by eSMP staff-, arSd was 
geographically proxlrnate to the adopting site. The availability of a "turrkey" .. 
trainer Was oftert'a t^e(^slve factor In th^ addptloi process. 

It was the rare_dlstri6t that followed e$MP*s 'specif leatlens_fbr traihih^^^ Frdm 
teacher survey data^ between a quarter and a half ef the teachers^receiyed less 
than 50% of the recommende^d namber of training hours. Most teachers had no 
further training after they began teaching GSMP* 

In several districts^ teach er? assumed a m^br training rple^ by enccyraging other 
teachers to observe their eSMP lessons, by cTjriductihg or assistirg. at district, 
in-service cteys^ and by arranging informal odhferences within_^their buildings or. 
acrossihfe district. Atl^'one site, a hg^r-Urje was established where teachers 
provided^ after-schodrhours assistahc#td Iftelr cdlleagues. 

Althou^ in most cases traiaing did hot meet CEMREL's _sp«U . - 

ihtef^ity and duraStei, a majdrlty of teachers surveyed thought Jhey were \, 

adequately preparecTto teach CSMP. Those teacheTS_ al_^ sald most other 

teachers in their sShobIs could do an adequate job of teachingjC 

they had any suggestions for Imprdvlgg the tralhlngj^ teachers ma^^^^ 

tiphs for progrgm)jlTa£ic change but Asdme recommended (not surprisingly) that t^ie 

length of training be increased. 

_ _£_ ______ ' _ _ 

Where GSMP was most successful, teachers' invqlvemient with CSMP h^ been a 
key factor. Surprisinglyi length of training, intensity of training, and CSMP- _ 
conducted versus locally-conducted tradnlng played' a relatively small role in this 
success and were not correlate(J\:ver^^-'Mghly with; st^ achievement. More: 
important to success was the Iteachers' belief that they ebdld learn the math, 
learn how to teach -ft,- apd that their students vi^ould profit from it. Thus, the 
skill of the trainer irt. imparting this confidence was very imfadrtaht. A willing 
group of teachers could^iovercome many in-serviee cbhstrajnts. In fact, the 
■program's Impact on students miade converts of many teachers Who were initially 
reluctant. But teachers' resistance was _ not easily dvercdme and. many adoptions 
foundered on that reluctance. 
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Dally- Prepar ation and Materials Management 

A common response in teacher Interviews was that no ampunt of formal training: 
could prepare someone for be Many teachers sal d^ in _ 

eftect,J''^ou have to te^^ year." This was meant In the''duar sense of 

lealning to teach It and learning to gppreclgte it. Day-^to-day CSMP teahlhg 

a relaUvely coiT^ ercleavqr during the first teaching year. CSmP 
required dally^ planning acco and access to two or 

toee different yo^^ of Teachei^'s Guides during any single week. The 
teacher-led lessons _took m^ ipn^er than jriost: teachers were_ accustomed 16^1^ 
often requiring 36 minutes or more and occupying seven or eight pages in the'i' 
guide. Th^s, to be successful^ the teacher had to dev6fe both time (for \. 
preparation) and energy (for the lohg lessons). . lij 

in comparing Urne requ^^^^ CSMf=* JL^ep.a^^^^ time rec^jlred for ihi 

previously taught mathematl^ the most cpirimon response was "more 

at first but about the same after a year's experience". . This response was given 
by at esch grade level by J^tvvee^ of the teachers. The response 

"more at first and cjjptinues to be after a j^ear's experience" was given by 
successively more tf^hers at each grade levelY_goIna from 996 of first grade ' 
teachers to 3396 of sixth grade teachers. Fewer^than 1096 of the teachers 
reported that eSMP required less preparation time. , ^ 

Logistics 

The average amount of time r^SrteSby eSMP teacher^ for math class was 
about 45 mllhutes per day In grades rand 2, about 50 minutes iri grades 3 and 4, 
and about 55 minutes in grades* 5 and 6. Most teachers reported this amount of 
time to be longer than they previously. tdoR for rhath. It was also longer than 
reported by_ Nbn-CSMP teachers participating In the comparative studies of 
student achLevemeht^ grades 4-6, These Ndh-CSMP teachers repqrled spferfeihg arr 
average of 3 to 8 minutes le^ per day depending dri grade level. 

Furthermore, lesson time was distributed In a different way. For CSMP teactiers, 
nearly twd-thlrdsjDf _the time was spent ih_teacher-led_actlyltles; this was 5096 
more-than Ndn-CSMP teachers reported. Conversely^ CSMP teachers spent 
proportionally less dme supervising^ ani with individual students or small 

groups. A -sizeable proportldn of CSMP teachgrs (nearly one-third) thought they 
spent too ' long in exclusively teacher-led Instruction. 

CSMP teachers spent an average of 20% of their math time supplementing the 
program with other activities. Most often thi$ supplementatidn wa^ In .compu- 
tation practice: the basic facts, whole number algorithms andj^ In the ipper 
grades, practice with fraction aid^ decimal pperatlons. These Items were most 
often cited (by one-third to qnp-half) of the teachers, as skills or concepts "that 
CSMP assumed students year, which -many did 

not know", Of "that are not adequately covered by CSMP". 

p. 

When similar qjestions >^ere asked of Non-CSMP tea:hers, they^ reported spending 
virtually the same percentage of time supplementing, but thjs supple^eptirg was 
much more diverse. Mental arithmetic, metrfcs, math labs and gamesome 
calculators, word problems and enrichment activities were most popular, but no 
single topic was '^lisfeed by even one-third of the Non-CSMP teachers^ These 
topics are often thought of as optional and done- at the teacher's diseretioni 
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The method of supplementing was also rather different; GSMP teachers tended to 
do It In very short stretches^ The most common response to the. qdestloh of 
when this supplementation occurred - "for a few minutes at a time" - was 
given by about half the teachers. Nqn-CSMP teachers' most ebmrnoh response 
was "for several consecutive math periods"; This difference Is compatible with 
.the difference In what vvas supplemented, he;, cbmputation practice (GSMP) 
versus chunks of ccntent that^ make for longer units of Instruction (Nbn-CSMP). 
Teachers usually supplemented with teacher prepared or ebmmerclally available 
worksheets. Occasionally they assigned vybrk* fromi ebmmerclal textbobks that 
were in the schiool; frequent use of these textbooks was usually a sigh of less 
th^ faithful Implementation of CSMP; 

Where do teachers find the time In the eurrlcjjlum to spend an average of a day 
a week on these supplementary topics? In the case of Nqh-^SMP teachers, such 
topics may be part of the district curriculum but hot in their textbooks. Also, It 
is not unusual for teachers generally to simply not cover the last one or two 
chapters in the text; such texts are written with this real pbssibillty in mind and 
these chapters are not prerequisites for next year's work. CSMP teachers, on the 

other hand, did _ _ _ __ 

not consider their vsupplementatlbh to be op Uonal but there Is little cLcshlon in 
the eSMP schedule to allow for It. Heme, many CSMP teachers either omitted 
segments of the schedtjle or did not get through the schedule. In the upper 
grades, fnost CSMP teachers (75% - 90%) got pretty wejl to the end of the 
schedule but had to omit lessons td get, that far. At the lower grades teachers 
were less likely to .skip, lessons but more likely not to get to the end of the 

• . _ scheduler For all CSMP teachers, * tRFTlssons 'mo^ likely to_ be _skipped dealt 

with probabtluy and geometry, the content strands which are most different from 
the traditional curriculum, and least undferstood by teachers;^ 

There were some other differences between CSMP and Non-CSMP classes; 
Student qLiestidhnaire dataMn fourth and fifth grades Showed that CSMP students 
reported taking fewer tests and doInG) Jess homework; 10% - 20% fewer of them 
.responded "a lot" to the questions about how oj^ten they did 
teachers saw this as a weakness of the program; at every grade level, at least 
' 70% of the teachers thDught_that.;perIodic tests should be built into the curriculum 
for grading and general progress checks. 

Oh the other hand about 25^ /nor-e CSMP students reported that they played 
games a lot. Jhese HrT^Hn^i^^are unsurprising since the words "tests" and 
^ I'homework" are virtually absent from the Teachers' Guides and many problems 
and lessons are presented in a game context. Also, high amounts of supple- 
mentation were associated, with low amounts of pme playing, i.e., supple- _ 

mentaUqn replaced the game-playing l3art of the curriculum. Fd^Npn-CSMPj high 
supplement§tlon was associated with high game playing, i.e., game-playing was 

. - supplementation; , ^ 

*** ' • - 

CSMP ^d Non-GSMP tdachers in fourth throu^ sixth grade were _^ked to ^ 
respond to pairs of statements about their hnath class. A five point ^^ale was 
devised to show the relative balance between the two statements. The largest 
difference, in mean scores between C_SMP_ and Nbh-CSMP teachers ocAjrred for a 

• statement referring to le^on plans; CSMP teachers responded much n^re in the 
direction of "lesson plans are follow^ In great detail" versus "lesson plans serve 

^ only as a general guide". On two other pairs of statements^ out of a total of 
eight, there was about a half point difference in responses. CSMP teachers vvere 
more likely to say that math class had a fun (versus businesslike) atmosphere^ and 
that math class was oriented towards creative activities (versus solving^ specific 
problems). OD 
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Of patUeular ebhcern for a carrrculum Hlie SSMP Is th^,;potentIal problem of new 
students transferring Into the prbgrarrii These students must becqnrie farrilllar with 
the special eSMP pl^torlai^rep^ before |§ey c|^^ follow the . 

lessons, this problem appeared to be rnost serlpys at*tl^6^econd an^ 
levefe, particularly with the minicomputer. BOt regardle^ of grade level, the 
number of new students, the time j)f^ear th^y entered, and their general ability 
level determfried how big a problem they posed for the teacher. Orie ar two new 
students of low ability or seversi of high abUlty could usually be brought Into the 
program at the beginning ^^^^^ In a variety of ways* The spiral nature of 

the curriculum was undo Irr many cases since studenb^^ have 

to master the content of one lesson In order \X) benefit from the jpext -l^ssoh 
dealing with that content* 

However, whjn there were several low ^ability studenb and/or students entered 
periodically during the s:hcwij^ear, te^^^ reported having problen^. Test data 
showed that n^w students In general performed almost as well as veteran CSMP 
students of similar ability leyels. Nevgjj^hejess, teachers' perceptions of the 
problena may have been a factor In soflr teachers' opinions that CSMP was not 
appropriate for low ability students. Also, it was probably a factor In a_ few 
schools where CSMP evolved Into a program for upper tracf< students. As new 
students entered those s::hools, the slower ones were sometimes targeted to the 
teachers who used CSMP on a more limited basis, thus accelerating the spltt 
between CSMP and Non-CSMP classes within a building. 

Teacher Opinions about CSMP . . 



For several years teachers at various grade levels, were asked ^to compare CSMP 
with the miathematlcs curriculum they had previously used. The rate of return of 
these i^uestionnalres was about 50% -60% in the lower grades; higher In grades 
4-6. Mean_ scores were calculated at each jrade level by assigning a score of 1 
to the lowest rating ("much worse" than previous curriculurri) and 5 to the highest 
rating ("much better"). Ratings are summarized below in Table 6. 



. Table * ' 
* Mean Score bV Grade, 
Teachers* Comparison of CSMP to Pr\eviou8iy-Used Curriculum, 

Grade Level 
(N) 

Overall quality 

Student interest 7 

Students* logical reasoning ability 

Appropriateness for high ability students 
Students* facility with word prpbiemi 

Student achteveneht th itathemattcal concepts 

Student achievement in computation skills 

Appropriateness for low ability stud^ts 

^In grades there was only a single item, 'Students overall achievement**. 






1 


2 


3 


4-.' 


5 . 


- 6 


90 


lib 


'92 


118 


69 


43. 


2.2. 


4.4 


4.6 


4.5 


3.9 


4.0 


3.7 ' 


4.4 


4.5 


4.6 


4.2 


3.9 


3:1 


3.9 


4.4 


NA 


NA 


4.3 


4.0 




4.4 


4.6 


NA 


'na 


NA 


4.« 


4.4 


4.6 


4.9 


NA 


NA 


3.4 


3.2 


3.4 


3.3 


3.7 








3.7 


3.6 


3.8 


4.4 


4.4I 


4.3' 


4.0' 
















2.7 


2.7 


2.7 


3. 1 


3.0 


2.6 


2^ 


2.6 


2.S 


2.5 


2,3 
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The highest ratings were given for Items 1 to Ai dealing with overa|l qu^lIt_y_,_, 
student Interest, logical reasoning, and appropriateness f^or^hlgh .pblHty student|; 
Each was rated oh average, betwein "better" and ""^'^ch better" than ^ p^evl^^ 
carrlculom. The lowest ratings were given In the last two Items^ deaHng with 
computation skills and appropriateness for low afalHty students. Both were 
generally rated slightly worse than for the[r prevloos math program. 
Achievement in computation skills was rated at le^t a full point lower than 
achievement in mathematical concepts In grades 3-6. 

The question regarding appropriateness of CSMP for low ability students drew th| 
widest range of scores; there were relaUvel^ few "about the same" resppnse?^?nd 
many eitreme responses, both ^positive and negative. For example, among fifth 
grade teachers, 55% j)f the teachers thought CSMP was Je^ approprIate,^^iA 
nearly 38% thought CSMP wai more appropriatel ; It was the 
ratings came primarily from CSl^eachers who had many ToW ab^ ^tudents^Jf 
anything they came more from teachers with few low^ ability students. Non-CSMP 
tefehers, howee/er, were much more likely to rate their curriculum low on this . 
criteria 'if they had many low ability students. 

Teachers In grades K-2 gave more positive responses to CSMP^ than did teachers 
in orades 3-5. each grade level of which produced almost IdenUcal responses. 
The general Inere^e In Scores at sixth grade Is probably because that group of 
teachers was small and happened to be teaching relatively hi^er ability students. 

Fourth through sixth grade reajlts were based »n ^S'l'^r^lf hSus?^' 

pattiy because fewer classes had reached those grades, ^and partly becaiBe 
quesUonnaires in some years were collected only from t^f^eis of classes ^ 
participating In a comparison of student achievement. Both C5mP and No^^^ 
DarSciDatina teachers responded and their responses can be compared In Table J. 

CSMP? these responses are a subset of the resppr^es from the previous table; 
they are not appreciably different from those of the_ larger group. 



tibl« 7 

CSKJ> and Non-CSMP T»«rfi«r 

Conipirlhg PriSent progrsi to Pr«vlou«ly 0««<J Progr« 

Pburth Gria* Fifth Gr«d€_ Sixth GrSSi^ 
CfiKP Son-CSHP CSMP NOil-CSMP CSMP Mon-CStP 

_ 3b 23 2Z 26 

(N) 

, . : 4 0 3 3 4.0 3. a 4.4 3-7 

■ r' Overall quflUy ^-^ 4,4 3.8 

Stuatht intere.t and lnvolw«»ent 4.1 1.4 • 

Studenti* loqlcil r4««onlng .blUty * * 3.0 4.6 ^.^ 



Appropri^teneM for high^blllty .^^^ 4-4 3.4 4,S 3.9 4.5 3-4 

Stodeht** facility wlth^«rd_probl«« 3.4 2.5 J.^ • __ 

Student ichlevesent tn matheMtlcel concept. 3.6 3.3 J. 

Stodent .chleve-ent In c«putitloh iSllli ^-'^^.^r? I'l I'l I'.l sil 

Appr6p;rliteneee for lo%* •bility atudente 2.7J^2.« 2.4 



30 


21 


4.0 


3.3 


4.1 


1.4 


4.4 


3.0 


4.4 


3.4 


3.4 


2.5 


3.6 


3-3 


2.9 0. 


3.0 











CSMP teachers , gave higher ratings than Non-eSMP teachers on s^ven of the^^ne 
'terns The average difference was between 1/2 and 1 point on five items and 
over 1 1/2 points on two items dealing with logical thinking and appropriateness 
for high "ability students. 
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Isrph-CSMP teachers gave higher rankings on two of the nine Items, those dealing 
with achieyeilneht in cbrhputatibh skills and apprbpriatehess for low ability 
students. The average difference was Jess than V2 point. The eSMP' discrepancy 
in teachers' perceptions of .student achievement In computation versos edhcepts 
did not appear with Non-CSMP teachers, who rated thenri equailly. Appropriate- 
ness for low ability students usually vvas rated lower by CSMP teachers, but 
Non-CSMP teachers also did not give their curriculum high ratings on this itern; 

When responding to questions about the rnbst effective way to teach low ability 
students, CSMP and i^Joh-CSMP teachers ga virtually identical responses to 7 
out of 8 questions- The only difference between the twQ groups was that eSMP 
teachers were more likely to say that best learning takes place when a teacher 
can give Indlvrdgal help versus working with _§mall groups. Special provisions for 
low ability students were reported to be available by 85% of both the eSMP and ' 
Non^CSMP teachersj and were Usually provided thrbU^'a resource teacher on 
room. V 

When teachers were asked to describe .tflejr overSll evaluation jDf GSMP,. responses 
could be fairly easily, divided into thiree groups. About 65% of the teachers In 
grades K-;2, and about ^096 of teachers In grades 3-6^ gave an unqualified positive 
response to the pi'ogrkm, often dea:riblng it In glowing terms. At the other 
extreme, a steady 1015% of the teachers' were thdrc>jghly negative towards the 
program. The remaining teachers responses can best be described _as positive but 
qualified, such as "I like the program overall but..." About half of these 
reservations dealt with minor issues or were not cohsldered serldUs b^ the 
teachers, but two fa weM" raised most frequently year after year and 

were of considerable concern^ ^^^^ many teachers: the lack of attentldh In CSMP 
to the basics -basic arithmetic facts and the arithmetic algcglthms - and the 
perceived difficulty of the program for low ability students. 

Similarly, when asked to^ r^ the worst .aspects of CSMP, ^teachers rnost often 
alluded to these two concerns. Non-CSMP teachers^ Jiowever 
of the basics to be a positive ^pect of theij* program. In naming best aspects, 
eSMP teachers almost airways named thinking jd<llls (problem soivi^^ * ; - ^ 

work, creativity, reasoning, challenging, etc^) or motivatioh/Interest;;^^e^ tvw; ^ 
BTeas were more likely to be named by Non-CSMP teachers' ds w^K^^^i^ts of. 
their programis. ^ 

Next most frequently named ebm^plaints by CSMP teachers were that j^^qns were 
too abstract, that too much of the lesson was teacher-directed, and that students' 
did hot have the prerequisite skills needed for some lessons. 

Gne area in which CSMP teachers* opinions changed dramaUeally by grade level 
£:dhcerrs the spiral approach. In giving free responses to a question about the ' 
spiral curriculum), 74% of first grade teachers were very positive and only 19% 
n^ative. These figUres changed mbnbtonically by grade level until at fifth grade 
there were 30% very positive and 30% negative; the other 4(3% expressed 
qualified approval. ' " 



Fifth and sixth' grade teachers were asked to respond to a serJes of statem.ehts 
about the spiral approach. Three statements produced strong 'nearly, ahannbigdous 
approval of eSMP: teachers agreed that the spiral approach was more interesting 
and students felt less pressured than in a. mastery approach, _and teachers did mt 
agree that students never master the content. However, on four other state- ,_ 
ments, about half the teachers gave responses that were negative towards GSMP: 
teachers had to repeat a lesson because students didnt remennber, the spiral 
approach only worked for some students, too much time elapjeti before the class 
returned to a topic, and 2-4 consecutive days on a new topic would be preferable 
to the e'arrent schedule. These statements also appear in free response evaltia- 
tions. bf^'the spiral approach and in teacher interviews, though less frequently in 
the lower grades. 

p.SMP, The Low Ability Student, and Computation 

The m^t common complalhts SbOut CSMP are its perceived inappropriateness for 
low ability students and. its lack of attention to developing . the basic eomputa- 
tidnal skills. These two complaints surfaced at ail Jevels - teachers, principals, 
eoordinators, central office staff, school^Mards and parents. No school was 
without at least one or two teachers who disliked the program for three reasons. 
In the upper grades the program is bein^ used disaproportionately more often by 
districts or classes with higher ability students. . 

To what extent are these complaints justified? Data presented in the next 
chapter will show thatvCSMP students perform about, as well as Nbn-CSMP 
students on computation tests and thatr^SMP low" ability students perform nearly 
as well as CSMP students at other ability levels vis^as-vis their Non-CSMP y ^ 
counterparts. On the other hand, there are oeeaslonal Instapces of wea<ne^es In 
these areas. In the large Extended Pilot Tests of fifth aocl-^xth-grade classes, 
for example, the lowest ability eSMP districts happened to perform poorly 
compared to Non-CSNf' districts of similar ability. When, data were analyzed at 
the student level, low ability CSMP students as a yroup fared worst In comparison 
to Non-CSMP students in corrputationally oriented tests. CSMP classes whose 
teachers supplemented the program least, and Who most agreed with the CSMP 
philosophy, tended to have the lowest computation scores. But the few flndj^ngps 
of this nature are overwhelmed by miost other findings. The data dp not SLp port 
the intensity felt by some teachers over these issues. It is worth ctxisidering why 
teachers felt this way, given the overall data on low ability students' success. ^. 

The computation issue seems the more straightforward of the twp Issue^ " fiven a 
cursor* review of the CSMP materials reveals, that . there is less computation 
practice of the paper and pencil, drill and practice varieEyT It is not •likely that 
this difference is entirely cornipensated for in the teacher-led lessons^ certainly 
not when it comes to the multiple-digit algorithms. Very few teachers rated 
CSMP better than their previously used math programs in student achievement of 
computational skilllf mcst rated it a little lower. Teachers did supplement to tne 
extent they thoughCf necessary and this supplementation seemed to help. * 

Some CSMP users approved and supported this supplemi^ntation and did not feel it 
to be a particularly black mark against the prograrrj. Teachers generally know . : 
how to teach computation skills. The^ were able to fit the stpplementation in 
with short bursts during class or as homework, had lots of practice materials 
around, and could easily check student skills. But many teachers were encourage^ 
not to supplement by Coordinators and by the Teacher's Guides whose spiral \ 
philosophy downplays the need for supplemeritation. 
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Regardless, of whether this sapplementatlqn, was done surreptitlousiy or with 
approval, it reqaired additional Ume an already crowded schedule. In some 
d.istricts this was recognized arid taken into account but usually the additional 
time burden fell squarely on the teachers' shoulders; j»Thus, this perceived 
weS<he^ probably does exist^ can be amieliorated fairly easily, and at a cost 
which seems high to some*teachers arid low to others deperidirg on their view, 
and their district's view, about priorities In mathematics education. 

The issue of appropriateness for low abiHty_ studerits is more complicated. 

Substantial though smaller numbers of teachers felt that CSMP was more 

apprbjDriate^or low ability students. Jn questionnaire and Interview res^nses, 

many teachers said the program had positive effects on low ability students: ^ 

".♦.seems ID<e studerits working at ail cojnitjve levels get something cut of",. . 

"there's something for that child whQ Isn»t quite as fast...can still participate and - ^ 

be ri^t arid (the program) clues me intd what ^he^xe thinking". Given these 

teachers' views .anid the generally positiy^e test dataj^jt Is worth considering why • \ ^ 

so: _ many teachers did not like this aspect qf the program; A few reasons are :. 

offered here. , -/ - I 

For many teachers, the Issue was tied to the computation issue; They had sfiSe^^^^^ 

doubts about whether parts of GSMP, especially geojrietry and probability,^ really ^^'-^f^^^^ 

taught mathematics, arid whether, these areas had any practical value.: They hel^i^' 

^ese views everi more strongly for low ability students, whose prinnary 

educational, rieed was seen to be adequate eomputatibrial skills. Higher ability_ - ^ ^. 

students, mi^t or might not learri problem solving skills bjjt one way or anq^igr^ J' : 

wdu^d pick up the necessary comiputation skills, bow ability students could :n6t_be ^> ^ 

expected to learn mariy probleri^ solving skills and jvithout the teacher's help 'they 

alsp wouldn't develop adequate computation skilfe, , - . - 

Teachers of higher ; abjl_lty_classes, with bhly a few low ability students, were * ^ 

more likely to think CSMP ihapprdprlate for 'low ^ a^^ than teachers of 

lower ability classes, with rriahy low ability students. The gap in achievement 

seemed to widen for sditieK|teac:hers of high ability classes, this' rriay be because " 

CSMP^ gives the teachers many bpjDbrtunlti^s td.se^otheir childreri- working at 

g^enulne problems and responding In class to difficult. qUestidhs.,, Clearly some . . 

*udents show abiliUes that were previously masked , In the tJaditldhal cdmputa- : 

tionally oriented pro^rrin^. The three and four-star wdrkbdbks cdhtaih some 

genuinely challenging material which some students gobble. 143 while dthers never 

even see. There are probably more occasions tten^ f(S*rnerly fdr gddd students 

"get it" and become enthused while the slower students appear lost. 

._t?_ ___ __ _.. _. . . . _: . 

Thus, even though low^: ability students benefited from CSMP (as test 

data suggesOj teachers^ day-to-day experi^ that^these 
students wej-e getting farther and farther behind. The CSMP curriculum does not 
contain progress tests, but tea^^ check their students' computa- 

tlonai skills against their own well-deyejoped, experienced-based standards and find 
the program lackirig. They did not^ have -an easy way to measure students' 
thinking skills, rior a st^ridard agalr^st which to compare It, so could not see any 
compensatirig gairis. , <' 
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Many teachers stated that^ the gpiral approach didn't work for low ^Hity students 
and that they had to reteich crucial parts of a previous lesson because ^^^^s^ 
didn't remen-iber from the last time. This led sDme teachers, sometimes with ..^ 
district support, to regrot^ lessons and teach several related lessons In X W^^^ 
contrary to the recommended schedule df logons- Observations aj^ggest teachers 
may have been ri^t in some Instances, but it was sometimes hard for anyone to 
- determine which elements of a preylous lesson really were crucial. was also 
^ difficult at times to predict whither or hot students would somehow muddle * 
through the new lesson in spite of only a hazy remembrance ^ of ^ th^revious - 
lesson. V : . / 

: _ . _ : - - 

eSMP places heavy errphasls (XI the "guided discgverj" apprjDjl^ ;^This^^m 
asking questions that students haven't heard asked before, le£ aione 'know the 
answer to. The ratio of qUestlphs that students can readily answer- 1^^^^ 
number of questions asked In lesson Is probably much lower 'irr> CSIvp than in 
traditional programs. So teachers see many more Instances then they are used to 
of Jdw ability students hot being able to answer a question. 

bow^r'abifiiy students who transferred Into: a CSMP classroom were fdeed with 
sp&iml.'catch-up problerBS because they had to learn the special eSMP represen- . 
' tationaJ languages. AgaS^ test data_ indicate they did catch up but this 
undoubtedly requires sp^Iar efforts by teachers wRIcFi would not be necessary in 
a traditional program. The spiral approach, though heipful in this regard, may 
also stretch out this catch-up process. 

In summary^ some teachers' day-td-day experiences suggested to them that the 
program didn't work well with low ability students and this conclusion was not 
altered by abstract test data. This opinion was reinforced If they did not share 
CSMP views on decreased computation emphasis, the spiral scheduling approach, 
and guided discovery jessons. Most adapted the program In sensible ways to 
rertiediate this problem^ and the adaptations may often have been warranted. 
Some made such extreme changes that the program became very different and 
gradually ceased to be taught. 



Tea::her Observations- ' ' . * 

— ^ . ■ . .. ; 

Tethers at over 46 sites have been observed_teaching CSMP. Most lemons 
observed followed the intended lesson in the Teacher's Guide at some^ level of 
correspondence, but there was wide yariatidn in how faithfully, and how well, the 
lessons were taught. This variation did hot seem to be related to objective 

factors such as size and ^ility of class, district circumstances, teacher , 

experience and background^ etc. It_had more to do with teachers' general teaching 
skills and their understanding of , CSMP. 

GaneraUii^hing Skills. Most tea::hers had at least adeguate classroom 

ment skliis; students were reasbnably quiet and attended to the^lefeon/ teacher 

and students f byld be heard, Wdifk was asslgned arri the assignment understood, 

materials wer% # hand fpr use. A minority of teachers, perhaps 16%, had 

management problems that were enough to disrupt the lesson^ s^^ 

somietimes temporarily, sorrietimes for the duration of the lesson. These, problems 

had nothing to do with CSMP arid- no doubt affected learning in all subject areas. 
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But CSMP placed ah added burdejl oh poor rhahagers because of the many student 
and teacher iriaterlals^ the complicated schedules^ the long lessons arid the lack of 
closure (objectives) Inherent In CStvp^s spiral approach. It may be that such 
teachers could ccpe tietter with a_A^ery traditidrial . program irivolvirig^ say^ 15 
minutes of lecturing followed by 25 minutes, of, drill and practice Iri a very 
circumscribed, cdmputatidrially oriented curriculum. ^Iri either case, the students 
would have to take oh a larger burden of the learning for themselves; hi^er 
ability students can do sd^ lower ability ,studerits cannot. 

In addition to haying basic rhahagemeht _s^ mc^t teachers also had reasonably 
good expositor^ skills. Usually adequate for explaining the mathematical concepts 
and^ills in CSMP^ provided they themselves Understood them. The teaching 
skills that were most Impdrtant IhJCSMP had to do with asking question^ arid 
celling with what ml^t be called CSMP's ••gUIded discovery" .le^dris. Questibri- 
asking techniques needed for student learriirig Include thj^e^^dwirig: 

asking for several aiswers to a question 
and*^ asking "why" lor "why not" qUestid^s^ 

t. 

basing e next question on an evaluation of thfe previous respdhse, 
waiting a few seconds after asking .the questicri b.efdr^ naming the rispdrideht, 
distributing questions widely, 

matching questions with SDility qf the respondents 

following up on the consequences of an answer, . . 

wheri^ necessary, asking th^ easiest question or a related question that 
has been previously ansvvered. • « r . 

^ny good teacher s^ tlieje questioning ^ills^ Bit their ciycla^ 

Importance Jn determining liow ajccess^uliy^SMP the classroom 

lies in the extent to which the prograrn demands and rejie5 crT tt^m. The j;^ 
"pedagogy of situations" Is Iri |ome ways a problem Maying approach, and thgUist 
of question-asking techniques given abbve.^ contains many ^hat are riecessary for 
any good problem solver. Qne reason problem) solvirig is riot taught often or well 
is that these are not e^y techniques to learn. For examiple, Iri developirig 
lessons, some teachers shortened the lesson to what was virtually, •'Here Is the 
rule. Now apply it." Althou*;fthe lessons in the Teacher's Guides are full of 
suggested sequences of queSflsfis arid possible responses, they cari riever be more \- 
than guides. FoUbwirig the guide slavishly created as mariy problenns fbr teachers ;^ 
as straying too far frqm it did". ; _ ' ' ^^^ ' 4 

The vast majbr^ty of teachLers h^^^^Sd some bf these, questibn-askirig techniques 
well, bthers nbt sb well. ". Perhaps the hardest tb acini eve was respbridlrig 
effectively tb ciri Iricbrrecf' answer when that ariswen. shbuld J^ave provided a 
tiB-bff. about ah^_I_mpLbr tan t mlsuhde^^^ of a concept. For hnariy teachers It 

was clear that CSMP was their first experience In a cUrrltxilum vyhich explicitly 
required these techniques arid they were making a genuine effort tb use them 
accdrdlhg tb the Teacher's Guide. 
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it is this fact whieh prompts , many cbbrdihatbrs'' to. think , that the real strength of 
CSMP is in the teacher training it_provides through the Teacher's Guide. Visible 
[fTprovement cduid be seen in some teachers after, a. year's experience^ they 
became better question-askers- it is unfortunate, that most did not receive the 
kind of intereive in-ciassroom support from cdbrdihatbrs that would build these 
skills faster. 

A related issue of critical importance Was the way teache^^ incorporated CSMP's 
guided discovery approach; Decisions had to be made thrbughbut the les_spn about 
how long to wait for an ^swer (or try for_the correct answef)^, how much to 
explain, how many questions to ask, etc. Though there is seneral_agreement on 
what the good question-asking techniques are (observers taiow them when they .see 
them), the effectiveness^ of .the best kind cDf djscqvery approach has always been a 
source of disagreerhent ^among educators. When observing CSMP lemons it^was j- 
mcKt often the pace of the lesson that had the greatest Impact on tf^ observer. 

There was wide variation in how quickly the Je^in m^^ 

lesson which might have an intended deyeloprnent time of, say, 25 minutes, about 
20% of the teachers might dp It in 15 minutes while about 35% would require at 
least 40 mlnutes._ Sorne of the variation In pace was related to the overall 
ability, level of the class^ but m was due to teacher differences. Probably 
more teachers err^ on the side of too slow a pace than too fast,^ Some , 
teachers slowed down when computation was requirecl"' and then speeded Up during 
the problem giving part of the lesson. Gertainly th^_ most: effective lessons were " 
those with a crisp pace eontrolled by clever c^jestibnihg Jind suppbrted by 

.thorough prepgtration and understanding of the: lesson.^ The niost painful to watch 
were the ones which dragged ihtermihably as te^hef^'belaborect u^^ 

'points or repeated unnecessary examples. .t^ '.^ ; ' ' " ■ 

This difficulty in judging pace is Lrderstandable:1^yen ;t nature of most GStvlP 

lessons; Because many different mathematical ideas;'!? e .tbuched^^c^ ' 

lessons, there is often no single fbc^ point fo| the ■tep:t^er _to 'c^^ 

skipping parts or adding other parts." ; Ih most cases of ^si^ from 

the lesson, plan, the resulting. lesSbh Was less effective thart tHe*^ 

eompounding the problem was the natural* and perhaps, justified^ reluctance to 

zoom on to the next part of the lesson* while students were still havjng 

difficulties. _ In sprne cases it would have done no harm^becaLBe of the nature of 

the lesson since the developer rna^have expected sqme_students to g^^^^ 

of it than others* or the concept was to be developed mbre fully later; But in 

other cales, that part of the lesson v^i^truljy^: a prerequisite for und 

what would come next. Only a thorough understanding of the iesson, and other 

lessons In the sequence, could enable the teacher to make an accurate decision 

about when to stop and regroup and wh^n to move on; 

Overall* lessons took longer than intended by the developers. A single long lesson 
might be split into two lessons by the -teacher. An additional lesson mi^t be 
prepared by the teacher for consolidation or as a worksheet assignment because 
the whole previous math period was needed for the teaeher-led p^rt jDf_ the 
lesson. This lengthening of lessons. In an already full yearly schedule <with 
occasional time taken for supplementation), caused nnany teachers r^tto completi5 
the schedule or to drop segments of the schedule that they cbhsIdefH©to. be too 
hard or too much off the main track, such as geometry and prbbabllit^. Again, 
this happened* more often in lower ability classes. ^ " ; ' 
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,^On the whdle> most teachers did a fairly good job of pacing their lessons and 
"learned to improve wkh experience. The teachers who had the most difficulty in 
maintaining pace were teachers who were naturally inclined towards mastery 
approach^ but who nevertheless attempted to teach the lessons according to the 
guides. At the dtHer extreme were_ a fev^ teachers who preferred a directed 
teaching' approach^ changed, the spirit of the lesson to fit this preference, and 
thereby did most of the thinking fof'the students. 

Teachers' Understanding of C5MP . There were three ways In which teachers' 
xjnderstanding of the program played ah Ifflpdrtaht role In the quality of the 
lessons observed. At the lowest level was simply being prepared 'for the lesson: 
knowing in advance wtiat the sequence of a^ctlvltles was, preparing needed 
blackboard demonstrations, having other student or teacher miaterlals available, 
ftaving some idea of the way questions ''wouLd ,be_ ask e_d^ and knowing how long to 
^fcyote to various pdrticins of the lessons. This is a fairly onerous job for first 
year CSMP teachers since many of the lessons run eig^t pages or more inTFfe" • 
Jeacher's Guide. It was not Uncbmmbn for ' teachers . to have ^he Guide firmlly in 
hand throughout the lesson. Some teachers had obviously done little preparation 
and this contributed to sense of fldUndering^ long pauses and eventual loss of 
interest by_ students, a generally vicious circre that made lessons very long. . 
Other tethers were superbly prepared and in full cdhtrbl. Most TeTl sbmiewhere 
in between. Gradually^ dependence on the Guide decreased with time but even ' 
for experienced t^^effcit was rare not to see the Guide opened at the right 
page and handy fOTOccalional reference. 

The next leve^l of teacher m was the content: how to solve the 

problems, know the good strategl^^ games, know why sdrnie 

answers, are good and others poor, and know all this well enough to respond 
rapidly to classroom situations^ _Lpng pauses while the teacher figured out an 
answer almost aJways disrupted the smooth flow of the lesson. It was at this 
level that th§ more matherriaUcally^^^^ an advantage, but even 

for less able or interested in;^mathematics such problems could tied to 

inadequate preparation, i.e., not actually going through the various problems and 
situations and thinking about them as^ they did^^. Wrong answe^^ Q^y^P by 

tea(jhers on occasion, or they accepted an incorrect^ answef from the student. 
Bep^use af the potential damage of such errors, this possibility 'became a source 
of tension for some teachers and they bepame flustered. 

In other classes, students were obviously used to this happening occasionally and 
corrected the teacher who made a matter-of-fact adipstment and continued with 
the lesson. In many, ways^this xespbnse fdstered a- very healthy and cooperative 
atmosphere for learning. In defense of the teachers, it must be said that beca&e 
the CSMP materials are so rich and layered with many levels of mathematicat / 
thinking, the curriculum is replete with situations amenable to teacher blunders or 
Icrig pauses. Such errors have been observed in classes taught by CSMP develop- 
ment staff. Most teachers were somewhat apprehensive about the CSMR content 
when they first began teaching the curriculum, and this was especially . true of 
t_eachers at the Upper grade levels. But with experience and cbnsclehtlous 
j(ieparatidn, they wfere observed (and reported themselves) to have imiproved 
dramatically.' , : 
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The highest level of CSMP understandingj and the^^^^ an 

uhderstandlhg of why things were done the way theyjwere, he^ 

behind the' yariouirTeSphs aid exerpises* There are many oe neja l statemehts in 

the Teacher's Guides about the various mathematical aspects of the lessdris, and. 

about the problem solving and higher order skills being enrp^^ 

are not described anywhere In detail^ or In behavloral terms^ rwr are the^ 

categorized or referenCgd. It was often* difficult Jor the teach^^^ where a 

lesson was going or wtl^S'partlcuIar sequenci^ o_f_ lessons^ appeared ii the 

curriculum. The lack of Understanding aboiutj and Jn sDme cases cJisagreement 

with, the philosophy and goals of the program occasIonally_affected teachers' ^ 

attitudes towards the program antf their subsequent performance In the elassroohrf. 

This attltUdlnfl problem was likely to 5et woree rather than better with 
experience. Some teachers came to see the program as having an excessive 
commitment to nebulous kinds of irnieasurable thin1<ing skills resulting In a weak 
'development of the familiar skllls_ and concepts that teachers approve of and know 
•how to teach. Amcng the ways In which this attitude manifested Itself In the 
classroom were the follqwing: an impatience in getting to Jbhe point of lesson, a 
fixation on getting the correct answer, a need to see observable progress in 
students* performance, subtle to drastic changes In lessons *ahd sequences of 
lessons, "an Increased emphasis on student written work, limited expectations of 
what students are capable of doing, and sharply defined expectation of mastery of 
certain skills at certain times. 

SLrnqiary of Te^hRf Observations. . In summary, teachers who had gcX5d general-^ 
ized teaching skills, who were willing to prepare adequately In order to learn the 
content and J§ssons of the progrann, and who understood and agreed with the^ 
philosophy of the program, were able to do an outstanding jDb _In the classroom. 
Many mem.orable lessons were dbse^ w^hich cried for a wider audlerx^e to see. 
the power'bf CSMP in the right hands. But this cqmblnatlon was hardly the _ 
noiiin; more cbmmdhly observed were lessons presented In a_ fairly competent way 
by tethers doing the best they could with a difficult currlculumv T 
got better with experience and the highs generally outnumter a 
significant minority of teachers, several pieces of the combination of fa^ 
listed above were absent and the teaching of CSMP moved inexorably towards the 
more traditional approach. . 




summary 

- - - -- - - - - _ , - ----- - 5^ 

CSMP has been successfully Implemented in many -different, kinds of school 

districts with many diffei-ent kinds of students. Through 1982^ 134 school _ 
districts had used the program and as of 1984^ approximately 55^000 students 
were using CSMP, The program tends to be used less often in grades 4-6 than in 
grades K-3. There is also a trend toward usage by higher ability classes in the 
upper grades. 

In aiy given year recently, over 90% of the districts using CSMP one year 
continued to use it the following year. The curriculum Is still healthy in spite of 
virtually non-existent support for dissemination from NIE since late 1982. ^ 

The role of the local coordinator has- been^ vital to th^^ajccess of C^^^ 

a filled ^d influe^ntlai^^ers^^^^ the helm^ a a^Hd Impfementatlon was not 

Hkely. Coordinators from outside the distric t (such as local Uni vers! ty 

profe^or)^ or with single-school responsibilities (such as a principaJ[ or teacher), 
were much Je^ ajccessf ul th^^ with district wide responsibilities 

(such as a mathematics supervisor). 

The coordinators' biggest concern, and most difficult job^ was training teachers 
for CSMP. Teachers and/or financial support were not always available to the 
extent nece^ary to meet the CSmp recommendations for training (from tvyo to 
five days depending on grade level). Consequently, at least half the teachers 
received much le^ than the reeommended amount of training. . TWs jpb got 
harder as more classes used CSMP, at higher grade, levels, and as new teachers 
entered the system. ^ 

Another constraint on the Qse of CSMp was the cost of the program^ which 
tended to be competitive with traditional programs in start-op costs but more 
expensive to maintain, particularly -^n grades 4-5 vyher^ consumables needed to be 
purchased each year... ^ 

^ - - I - - 

Teachers who had good general teaching skills, who were, willing to spend the 

time in training and dally preparation, and who agreed with CSMP's overall 

philosophy, were able.tp do en outstahding job of teaching the program. The 

absence of any one of these three attributes - skills^ commitment and phllo- . . . 

sdphital agreemeht - reduced the program's impact in the. ciassrddm^ and it came 

to' look more like the traditional mathematics currldulum. But In any case^ -most 

teachers supplemented the program with cdmputatldh practice and drqpped 

portions of the cUrricUlum, especially lessons In geortretr;^ and prolbabillty. 

Questlonnaijre^^lit^frd^^ a large number of CSMP teachers^ showed that teachers 
fated CSMP hlgher\han the previous curriculum they f5ad:.'Used, and higher 'than 
Non-CSMP teachers rated theij curriculum, in: * 

overall quality, 

. . student interest and involvement^ 

studenjts' logical, reasoning ability, .-^^ , 

appropriateness for high ability students, bnd 

' - i ^ ' • • . 

student achievemen't in/ mclthematicai concepts. • 
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On the other hahd^. teachers rated GSMP; less appropriate f^^^ 

and less effective In teaching computation skills^ tharr^^ previous curricularh 

they had used. 



In summary, although CSMP Is a difficult program' to irn0lement^ b^ 

has been ImRlemented successfully for sefveral years in many different settings. 



The previous -chapter concluded wltfr^llst of CSMP features that make It a 
distinctive curriculum^ and suggested v\?hy such features should make it a desirable 
program. The features will be reviewed here^ and it will be shown that each ef 
them is a double edged sword with equal potential for making it ah undesirable 
curriculum. 

1. CSMP contains recommended new content; 

The content is also new to_teachers, most of whomi have very little fbrmi^aJ 
mathematics background and do rot underst^ why such content is needed. 
They resist it and it is the first thing to be dropped in a timie crunch. 

2. CSMP resequences certain arltFrnetic skills and slows their rote develbprheht 
. to ensure understanding; . 

Traditional wisdom hold^that students should master certain skills in certain 
grades: addition-algorithm ^n second grade, subtraction. Fn third, basic . 
multiplication and division facts in third, etc. There is^pre^Ure to ccritinue 
this timetable because of test standards, student' mpbUt^y, parent expecta- _ 
. tibns and some teachers' belief that this Is the wSy the w© rid Is and should 
remain; ' ~ ^ 

3. CSMP promotes higher order thinking skills by presenting rich mathematical 
situations* Sueh situations do not usually culminate in a Specific tar^t' fpr 
mastery, but instead emphasize the process of getting there. Each le^o^ 
may have several objectives bUt hone has to be achieved for the lesson 
be sueeessful. ' , - 

. -3 

This organization contradicts much current educational practice which 
Emphasizes ah instrUctlbnal. process 0/ stating objecUveSj prov^l^ 
tion to meet those objectives^ measuring student outcomes, and basing next 
instruction oh the results of this measurement; Teachers see gamies of 
strategy as frills^ rather than as a way . to learn thinking skills. 



4. *CSMP lessons extend the length of ^e teachers engage the whole class/ 

^ This extereion requires more preparation by teachers and is physically, de- 
manding. Teachers havfe less time to work individually or with groups of 
- students, ^ 

5. CSMP has developed an extensive training progrWkSTdJ^i^ materials tS^^ 
help teachers use the curricurunri successfully. • 

f, ^ . 

Inservlce tralnjng Is difficult for most dlstricts^because of thp cost and 
extent of training, the iime required for teachers to participate- and the 
need for skilled traihers.. 
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6. ^ <?^SMPs schedule of lesbns incorporate, the spiral approach. * 

— - _ _ _ _ ^ _ 1 

The lacR of specific behavioral objectives flies in the face of ebrreht 
nnastery teaching whidi geniraUy prevents sUjCtents from progre^ihg to a 
nej^ topic antil they hav^Jekrned the olti^. Teachers feel □ncomfortable 
when tf pics are left trcorhpleted and vy#fen students don't remember 
everything from the last time a topic WSs covered. 

7. CSMP tees representational languages which are mathematically feotent and 
reduces the verbal load on students. ■ , ■ 

, . These lar>guages take arne for the teachers tb learn, raqulre cateh-ujD time 
tor new students and are difficult to explain to parents and administratofs; 
■ Sending wQri< home rometimes creates problems with parents. - ■' 



8. CSMP reduces the time spent on rote development of comptitatiohal 'skills. 

mst tefchere have, over the leirst Weloped good methods for teaching 
these sRiJls. Since the skills are easfl^ meaajred and hold a domrnaht ' 
position in standardized achievement tKts^ th^ have gglrted acceptance as 
the ••real" mathematics content for students. There is Ihcreasihg pressure on 
schojls to tie held *ce«ntabie for^student performsnce (for exarrple. throogh 
state mandated criterioh-refereTC^ tesling programs). Teachers believe 
these skills are the one oatcbme that alf^^dents must achieve. 
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9. CSMP prdvlcgs extensive Teaciier^s Guides with detailed lesson plans. 

Tea;hers need to put in more preparation time. Some teachers think that 
the guides are overly prescriptive* * ; 

ICt Student materials are attractive, qaSity and ea^ for students to ise. 

Because they are consumable, new materials need to^ te baigh t each year. 
This makes the program rrwre expensive In the upper grades thai traditional 
textbook programs where the text can be retced for several years. 
Moreover, since studert materials are ret in textbook^rrrt ^oois r . ^ 
sDrne times cant Use regular lextos* funds to bof them and it Is difficult to 
get the program on state-ajaprdved textbook tests. 

_ . _ _ _ • ^ ■ • 

Th^ traditional rnathematics curriculum, Used virtually natiohwide, is relatively 
robiBt. It can dmultaneajsly withstand many differ^ «hcfe of crftlcfem berause 
of its low cost, its easy-tp-measure goals, its famUIarity to alt'teachers arid its 
established position. CSMP, on the other hand, is relatively fragile; any single ' * 
one of the many problems described above can scUttle an, implementation. 

Sweeping changes on so many .fronts at the same time, as CSMP attempted, are ; 
bound to be resisted. One Pleed onljf look at the discrepancy described in the ' 
NCTM Prism arvey between math supervisors^ teacher trainers, and resea.rchers 
bh the one hahd'and principals, school board members, and the jxiblic on the 
bther, to l<now that the "first group - the mathematical experts - has limited 
pbwer.to change the views and practices of the^ second gfoup. 
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It may also be the case that OSMP is viewed, _eyjer\b^,^rn^ 
^ with the reasohihg behind its approach^ as a sDmewhat/fcben^t^^ pr^^^^ A 

• single^ cd^Isteht jDhlldsbphy and way of doing thlng^^^re omnipresent; one eoald 
hot call GSMP eclectic. Perhaps the point of _vie^ tl^at sparked d^^^^^ 
alsd prevefitga a practical accommodation to the &igencles of mari<e 
implement atlbh. ^ Or perhaps the creative single-rrflnde^^^ tx) produce 

a program of this scope and consistency is incompatible with such an 
accbminhbdatloh. - - 
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iVi STUDENT AeHiEVEMENT: TOTAL MANS SCORES 




J*^^^'^*'^^'^^^tP*^^1^ in the evaluation of carriculurr is "How 

ar^ student&\knowlsQ^i^^ different, as a resuh of their participatioh?" 

Arewerihg. t^S§,ji^B^^]^/^ith respect to eSMP presents some interesting prpblerhs 
for assessH'ient^ Goais* are given only at the^most general ievel, such as ^'dynamic 
creativity." In ihe spiral Approach, content is interwoverjiat successively rfiore • 
complicated levels, but expectation of mastery levels .at ar^ point in the cur-^- - 
ricdltrn^are absent. Topics in which certain rriathematical ideSs or processes are' 
used niay disappear after brief usage. There is a continual interchange between 
XQ^tent_*d proce^. And meet difficult of all, the special eSMP langceges are 
- The vehicles in whieK almiost everything takes place; concept development, 
V oapiDlicatibhs aid problem) solving. ^ 

The main vehicle for the evaltiatlbh of student leaprllng was the MANS Tests, 
Mathematics Applied to Novel Situatlbhs, a series of short tests, different at eafh 
grade level,^ developed by the evaluation staff. The tests probed important ' 
mathematical processes, sudi 'a^" relational thinking and estimation, by presenting v 
students with generally Uhfamlliar mathefttatic situations 'that did hot Lse any of 
" the special CSMP 'termiinbrogy^ fh^ t were administered to large numbers of _ 
CSMP and Non-CSMP classes ir) grades 2-6. This chapter will describe the MANS 
tests aid present student data. The next chapter will .qlescfibe student per- 
formance bh each of the MANS categories. .. ' ^ 



Oh the other hand, CSMP is ah elementary school cyfrlculum .which is intended to 
be the mathematics program for schools which adopt it. thj>s^ users have an 
expectation that the program will provide students with t^PKnpwledge aid skills 
'that are generally expected it these grade levels^ regardless of the Intentions of 
the program developers. In order to ihv€stiqate^t4i|^g^gcicern, a wide variety of* 



standardized tests was used over the course^-^^tlj 
^(Xicerns e>(:pressed by many teacher§/ about in 
^SMP students, this part of the evaluation cam| 

sections of standardized tests. The results of 

described in Chapter VI. 




n. ' Because >of the 
ytation^l skills of 
bh e cb mpu taif! on ^ 
idminlstrations will be 



Testing was carried jut in J;w5 w;ays. _The main ^urce of data for this report 
was from tests^ administered during tf^ Extended Pilot Test for each grade leVel 
of the CSMP materjals. These Pilot Tests were . initiated by CEiyiREt, with 
school districts cooperating as part of their participation with CSMP. A 
srcondary source XDf data for this report was a series of 3o!nt Researdn Studies, 
inflated b^ local^dlstrlcts and carried out cooperatively between CEMBEb and a 
local district oh Vi Individual basis. These 3oint Research Stijdles tbo^ place 
after the Extended Pilot Test and involved r^Is&J versions 'of both the curriculum) 
and the MANS. . ) 1 



In bfeh kinds of studie^s, the dg^s were cbrtiparatlve in' nature, with , the per- 
forrmtee of CSMP classes compared with that-^of Noh-CSMP. classes. The hnethod 
of anal^ls was an Analysis of Covariahce bh class hneans, with class score oh a 
reading or vocabulary test used as a cbvarlate.': ^ ^ . 
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The MANS Tests 



Description - " . ■ . ^' ^^-^ ; , ' . 

The MANS test5 were 'the prfricip-^ fjieasure of student outcome used-. Si" ;ti^$^^ 
evaluatisH. They a?e I'.coirectlon of short tests, designed to ase^ how, well • 
students can use mathemittcal thinking and skills in situations that are new or 
unfamiliar to them. The:$sts are in plain English and do not use terminology 
thatisi sp'eclfic to /any f^lftiCalar curriculu|i, including CSMP. _ 

The MANS Tests are .hormally contaihaj in twcD student booklet at each grade - 
levelreach of v^ch requires a period of 30-60 minutes <depend^g on pde 
level for administration. Ea* booklet contains several tests. Every test has Its 
cDwn directions' which: a specially tradned tester follow^ In explaining the ^^^^ 
descrlblr^ sample Items after which students then corrrplete the items^^in that test 
on their own. A flexible time limit, typically about 5 or 6 minotes, allows almost 
all students 'to finish. Most tests contain 5-9 Items. ' 

Each MANS test takes op one or tWo pages in a b6qklet ». that diagraim^d . 
illustrations are latge, wdrds are easy to, read and there is ample space for 
students to do scratch v^ADrl<. For mosfUests, students produce their ^own answer^ 
instead of selecting one of several given alternatives. Answers ;^e^ to be written, 
in the booklet and ^can be erased or crossed out; no special pencil is required. 

kt each grade level, one of the tests; Is a standardized vocabulary test, w^ose 
purpose is to derive an estimate of the .ability level of each class which can then 
be taken Into account, in subsequent analyses of covariance. _ . ■ . ^ 

A ^irrpie' version of Item sarrpling Is used for rfiost tests^y having two verslor^ , 
ofUach test booklet. Each version looks the same at first .g ance; pagination^ 
safele Items and format are Identical but the actually test Items are different. 
The\wo sets of test items are similar in general^dlfflcUlty but^are "ot /ieces-_ 
sarilJ statistically paraltfel. The class^ean is j^he main '^vel of analysis f^t the 
MA* Tests. Therefore, having a random half of the class take each version of 
thefasfcll! allpw% class means ^for a test to_ be based on twice as many items 
^^out extending the testing time. ' • ' 

The MANS tests are different in each grade level (grades 2-6). Althou^ some 
kinds of "tests may be repeated from one grade to the next,, with some over- 
lappTng^f items, "the tests are always somewhat different at each grade. 

The tests are classified Intfi categories based on mgthemaUcal ^process or conten^^^ 
There are seven process categories, each of whlGh Is represented by-^at least one 
test at each grade level. In addition, there are five sjDecIal topic categories 
which ^are Introduced at the upper grade levels. Appendi^ ^^^f'll^^^- ^f^J^^ 
the 57 MANS tests, groqped according to eategory. Each de^rlption includes an 
abstract of the. test, how It- Is administered, and some sample items. 



A brief -description of each pro^^ss^ category Is given. belowj together with Items ^•■ 
from Sonne of the MANS sec onc^ttPpH^.a^^^ sixth grade tests* Many of the Items 
shown have been much abbreviated f^^^ the versidns seen by students, but the 
set of ltenns for each category will give the reader a better bpefatidnal.uhcfer- 
standlng of what the Categories me^* 

go^utation. Straightforward calculation with basic fact and al|bfl*lms. Starv. 
dardizfed achievement tests of cbniputatldn were S)hneUme^ tsed Jj^iljfess this 
category. A descrlptloh of the tests^ and the subsequent results, ^fbe delayed 
uitll the next chapter. ^ 

Estimation, Rapid Calculallph of apprbxlmate shswei^^ trider short time limits- 
F^t tests were made up bf_ multiple choice iferhs. A typical test eohtaihed 
eight Items :td be answered in 1 1/2 minutes^ with suitable warnings to students 
ryt to calculate exact answers shd with fr^ueht shnouneements of how n^iuch 
Hme was left. 

Sample Items 

Second Grade Fourth Grade Sixth Grade 



i^O - \t is In which^ iritervtl 
0 > lb - SO - 100 - 500? 



602 u About ? is atffir &i 298? 
2, &. or iO%iiib«s 



« 1/2 . • 8 is: <1 or »1. or >l * 
Which ihtervij conUihs 1,002.5 ( 21.5? 

0 - 1 - id - 20 - SO - rod? 



Mental Arithrnetic, , Exact cbmpatatftin of problems amenable to hbfva|goriyhmic 
solution. The computation aspect of the problerro was downplayed; number^ were 
either small or easy to work with (such as multiples of 25, 56 or 188). Scratch 
woii< was not ceually alldwed. V : . ' - 

Sample items 



300 - ? - 250 



Hit « gaiii 5, iniii " lo« 1 
«U|rt with : 3 below zero 
enrf wiiS : 5 above zero 
# of misses : 2 
i of hits : ? 



12 % 75 

13 X 75 

1/2 X 
0,75 - 



900 



7 

0.5 



40 

7 



/rtoi lOibwed 



yskjmbe^B^pre s eotatIohs> Recoghltibh or production of ways .of representing 
numbers. In the primary grades, the tests vv^e re congee rned wit and 
place value; In the upper grades, fractions and decimals were emphasized. ^ ' 

Sample Items : 



100 more i/ian yOl Is. 



How many incKgy^ 



. * I 



i_L. 



Name the 2nd larger 4-<b^t 

r«iB?]5br using only 2. 5; 7. B? 



wtsioU are eqcd«^a]em to 1/3/ 
2/fi 11/31 3/15 4/12 



Wfuch arv equivalenl io_3/4 
0:750 0 075 0-75 7.5 



Put an arrow at J 35 in. 



50/150/ 



75 0: 

0 \ 



pttijr 
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Reiatidriships and Number Pat terns; Sofatlbri »id application of. patterns 
nurr.BprriiitldnlHpir~"(^^^ relationships Incn^ing ,^5 

seqti^hcesi brderlngj number rules and Iritepblatldhi ° > - > ; 

Saitple Iteitis ( ^ 



2 
8 

id 

6 



10 
4 

5 



.. |a|>,|M| «M" 



S/2 or 5/4 

0.9 or -D.nni 




wrtich is Larger? 

SHS ♦ 250 or 580*290 

Whal is the miasirig hiiniber? 
28. 25. '{ , 19. 16, 13 



What are the missing numbers? 
?, 50, ?• 200, 400. ^00 



^Ihlt fa: 

^ ^ Uian 1/8 

1^1^^ 0:2 bat smaller lhah 0.3 

Libel the misaii^ mimtKr 
— I t i 



10 
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Word Prnblpm^- Solutions of word problems requlrjn^lbw levels of computation 
ana reading eom prehereldn^ and classified according to types of pretelem", sucT^ «s 
one-, two-and three-stage, extri^eous data, fractions, decimals, and approxima- 
tlons. 

_ _ _ _ 1^ ^- _ _ : ■ 

ElucldaHnn nf MHlHple Rescgns^. Fluency In^producfaig as many answers as _ _ 
EE^IEliTfiirriTi given situation. There mi^t be an Infinite nurT,ber, of ^ f^sslble 
answers In the second grade sample) or a finite number of correct solutions - 
(as In the Sxth grade sarrple). : • . 



Sample*Iterps 



Write 1 Sentences about 8 
8 = 9-1 

6 - a 4 * 1 
8^214 



/ 



Take oat 3 balls together 
Adkl to get total score ^ 
Give ail possible scores 




Special Topic eategorles. Special topic categories .appeared mly inj^he^pc^ 
Sraaesln3~were given less enTDhasis than the proces categories. The b«lc ^ 
nremlses of the MANS tests were retained. Problems were new to the 5tui^nt^ 
and did not contain aiy special CSMP terminology, furthermore, tests in these 
categories did not require the knowledge of any parUiular content. They^vyere 
rather genecal ahd process oriented. The special topid categories are listed below 
and -will be deserfbed In the next chapter with the category results^ 



Pre Ajgebra (grade 6 drily). 
Geometry (grades *-6) 

Logic (grade 6 dhly) . 

Organization and Integratidn of Data (grades 5-6) 
Ptobability. (grades *-6). 
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The classification of the MANS tests is somewhat _arbltrary In that some tests 
ciDuId "reasonably be placed, in 6he of two categories. ^The categories themselve^^ 
were based partly on the ten basic skill are^ rrcommended by the:|^ationai 



important for mathematical thinking for eleiiiehtary school , students^ Each ..of the 
fdlldwihg categories correspond to one of NetM^s and NCSM's tjen basic skill ^j; 
areas; Word Problems, Estimation, eorriputation. Geometry, Organizing Qata,' and 
Prdbability. In addition. Problem Solving, the most important of th^. ten greas 
occurs thrbughbut the MANS tests- ^ 

Develdprheh t of the MANS Tests . : 

The descriptlbh bf.the MANS Tests given above is -reajly a descrlpjSpn of the 
tests after they had evtslved into their present form, the first ase^^f tests of 
this kind occurred in the first year of the Extended Pilot Test of second grade, 
when a tcital of 14 tests,, some group and sorrie individually administered, were 
given to classes in the local St. Louis area. In succeeding years, ic6 Pilot Tests 
of higher grades were undertaken, thif tests were gradually refined^ Directions 
were simplified so that_ testers at djB^pht sites couid'^ with some training, 
administer the tests. A reading tes|^^vas included eact) booklet, thus providing' 
a commcn measure across sites that could be used as a cbvariate. Item sampling 
by test halves was IntriDduced, thereby Ihcrreaslhg the number of Items that coulfd 
be adhninistered to a class in the ^ited available testing time.. Standardized . 
computation tests were included, dh a sampling basis, as part of the MANS Tests, 
eliminating the need for % separate testing period.. A classiftea|ibh scheme for*, 
the tests was, develop edt 



During^ test deyelopment for sixth grade^ the entire set of MANS tests for grades 
2-5^was revised to incorporate these changes at ail grades to in 
from grade to grade,^ an^ si^nplify adrnipfist ration, scbring and 
school distrfcts might un^ cooperation with CEMREL, 

tions of CSMP student learning. . 

- — ...^ ■ --- i- . J . 

For each grade level, the MANS Tests were, deve^jpfed using the ^ 
b^lom ^ . - ■ 




te the tests 
ting »D that 
wn eVSIua- 



rocess de: 
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Dex^eiogJ7:ienfe^ -ProtgtypeJests. Based on analyses of the CSMP- clr riculaff 
materials" :on the one han^'aTrd of ^railable^e§t materials (^rri 'ill s&urces) 
e othej^ a set of prptotype tests was developed. ^. 

/""^^^ _ / . t _ _ : ^ 

e eurricQlar review was csaally rftlper 'informal^ focusing .on general 
. raeesses that were repeated in difflfcea^eSMP contexts. Occastoh^y rnoFe 
fOi^ial reviews were c^fiada^ted^nd in fraauenej^ counts of various, 

types, of items, operatiyr^langu gge u s;^^ etc. Reviews of telt materials 
included stahdar'dif e"d Enlevement tests,jtests of :'intelligeriee or 
ability; tests '^usBj*in_^athernati(^edua^ research, ahdjfests used-.in" 
preyibus 'ci^^ulUhi._^alijat TtoJB^|^^ was <^?ore'inducuve than 

deducti ve>^i.ng ...tcnLhe 'iht^^ted hatOTe of the curriculum and its' lack|»f 
behaviora^I^^ot>jective5. ^ ^ . ~ 




The prototype tests deve toped from, this prbcgss consisted of a'sketcji of t 
diteo^^ns, sSmpIes and dla^am^^bi: the^ student page, a surnhnary of tester 
direiftidhs, apd Tew test Iteo^s.? ^ ^ 
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J 




^•^ese ^ prdt^jj^-i^^ res/IewLed by the evalua- . 



staffs the>xV^rr^^^ EvamSlien Partel, arjd the C«MP dev.elopment 

sUf^ 6_0TTietIfTies Coordinators and teachers also rev|ewed* Che; tests> ^ 
Revla^vers were SBked to rppand to* the lmpbrtaMq^bf _tttg Idea of telng- . 
tested^ the fairness of the Testing sitqatioa for bo^n es^^ ^nd Non-CSMP 
students, and the likely ' technleai ^ ^ailty of tHej^pr/Jfotype test a$,^ a test 
Instrurnent. Reviewers made nar^rows suggestions for lmpi^35?Jri^ task, > 
the presentation, the dipeeUons and the Items, • _ ' 

_ _ ' * . 

Based on this r^iew, a number of tests, perhaps 30 X oyera|l, were reacted 
out of hand for^arious reasons. The remainder were revised f 
according to r^vlfewer edrnments and hew tests' wefe created as a'result of 
reviewers^^g^pestionS. • ^ 

I nrat PUqU The revised -tests^ each with a full set of Items end car^^^ 
wfltten dlrK:tlonS, were administered to classes of average ablllty ln the St^ 
Louis metropolitan area. Usually five at sl^ classes were used in two 
because the first pHpt inevitably revealed weakness^ necessltajtlng^ r^ ^ 
and further testing. At least half of the classes tested wer,e ^r^^ 
•classes. Thrdughdut the plldV testing, observers, kept rwtes_ Pfjvha^^ 
especially: cdhcefhihg student questions and - dlfflcu^^ Bm^ f'eqqired^Cat 

this stage .students were given as -much time as needed). ^ - /. 

This pilot served two purposes. The first was to determli^ whether the ^test 
wa&i^'dr could be made, practical; The majoF question in this regard was^ . 
whetiher or hdr^(i|rections_anrf samples c^^^ >^ould sh^le 

all students to: St:ie3St irideSstand tttlft tes^^ M&ny proFtilsihgVscales had to 
be^ rejected at thi^lbge*-becfigse_5f tli^ partlci^ly Jh ihe lower 

gj-ades. The sect^c*^|ajrp^_e '_^vea the tests Wfes to Investigate the>, . 
statisticaJi properties pf^Ne pr^o?^^^ '/^t the . test level the^mosti V 

JrrpoFtant jfc these conditions' w^ mean percent cbrrect,>^reliability|. 
percent r«P^ing the iSt Jterns, and distribution of scores, a.e.j hdt^ large 
peEcehtagesgpf students ge^ing ^1 or h*ie of .the items coftect)rr7^t' the 

' item leveifliw most Impoi^nt'iprop^ties were percent rprrecti r-blserial 
correlatfBn, 'distribution of wrohg_ answers, and bereft omitted. 

The fMot gUrnifiated/ln the selection of .a set of- testk 

Year EPTi ^ini? addition to cdhsider^tibns pf m^^^ merit, practicality,* 

'and statisl^i^ propertied dn^^her^cphskleratloKc^ Important In this ^ 

selectiQrtl^^^he testing sessioh in which these tests were to be used, new 
Snd dif^etU^pts of probjgms would ^fdllavy- one after another. Thu?;j__ 
sfcudentW^^Gdes toward the tests^ and their mgtivatlpn for-*Ing them^ 
^??er^ S'rueia^ After each ci^t testing session, the tester asjjed stu^rj^^ 
jf dleat•^ by h^c^fbw mui:^ tl^ llked_ the test and^ these student 

-^dtes" were bhirhb^ cbhslderatlon ol( teS^^erlb^ 

Fir$t 4^eir Ex^qf^ ed Pilot Tests. Thi^elected testi -were carefully 
TormaftS injtoftWd or.' three studerit tookjets^ e&h requiring orip^ testing 
session rahgif^ftohni 30 minutes for second graders, to 60 rnipratesj f or sjxth 
graders^Ttrc tests-'were' then administered iRMfe^ ^^^^^^^^ one or 
two trjiinea testers ts& about ten C^NP and ei^Non-eSMP\efe^s in the SI 
Lbilis ^rea.J « . . 
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An extensive statIJJt|lcar Jhalysls'bf the results of this administration ^as 
reported tdl :tl1§ E valuation Panel durlhg the panel meeting^ held In St. Louis 
each fall. Thls_ review served two purposes. First, it provided a prelin-ilnary 
evaluation of CSMP students' achievement in ebmparisoh to Nori-eSMP 
students. Second, it allowed the* panel te rinake r^eommeridaUbris for test: 
revision^' Virtually all tests wer^ revised; some were revis^ spbstahtislly 
with new directions aid format while others required only a revision of a 
few items. Other tests were eliminated entirely and hew ones developed and 
pilot. tested to; Increase cdverage\bf certain tbplcs. . ; " 



5. 



Second Year of ExteiSJed Pilbt Tests; the revised tests were fb^rh^jttr^ Info 



4-" 



16-page student tJoeiklets .ahtf printed in cfLiahtity on Inexp'er^lve ni^s^irjt 
paper. Revised tester manuals wer§ prepare and distributed t^^^estei^ '^wljo 
were hired at eich site ahd_ trained by GEMREb staff. AltogethWabbut ' 60 
: ^. classes were tested In the S«:bhd Year -EF^, and the result? of this testing 
* ..^ form tlie main.data presented in dthls . chapter. 

. ^- ' ■ - --- \- . ^ -V... > - 

From the beginning of the ^develppmeht of thS f^NS Tests thrbugh. ffrtal revisions 
at sixth grade, the Evaluation s remaih^d> falf^ stabl^ Ctwo mernbers of the 
usuaKsthree-perstri 00^ dh .stOTf tiSrbUghbut) and the flve-pepson 

EyaluaU^Panelh^^^ not at atfl. A cbmmdn Uhderstahdihg bf wh^t the. MANS 

> Jests' wete/int^r^^ to gb*^bbut develbping them, Jed ^ to' 

^<^^n efficient^ Ihforhiali-and prodUQ|l^. working relatipTiship. At "arly time of the 

^':j;^eveIopni^ent /pro(^^ Sketch out two or three prbtbtypeVtests,' : 

* ../serri them to tH^^i^^^eiM^ col^mei^s^ revise the tests^ iQcafe aid schedule 
pilot ^es, Bd^^^^^^^^sts, anaTyze* them and make revisions^ all within a 

At each'ajccessiye^aG^ more bifficult 

^ bafause of the^inci^a^^^^ allowed for more ^ 

■/ ebmpHpa-ted Ji^^j^^ o1^ content and 

jV^^mathernatical pro^sses that Tie^eS^ be^rr^asured." ''^^rthermor array of 

^-l^ saitabfe, tests was larger t^S^Jre pi^^^^ It includeii nejt onJy the ^ 

new tests* especially deyeJeSfe^ for t^^ but also all jDreyimsiyl^^^u^ed - 

tests in. earlier gradS levelst §Ver^^me 'c3ron$ider^^ th^ir - 
diffiealty for those younger stud^is. 



Con t ertt^_£Q vexag a* 
the "Extended PHot Test 




The norFibei^ and 
shown by 



reeht of itepoi;^ each 
rade level' iq TaS^ 8, next p 




_cat egory * dur ing - 





8 

Pircint of H*NS ^•^^ by 'C*t«9 



MANS Cat«9orl«a' 

Ion'' J! 



GfAm 2 Grad« 3 




'E»tl»«tlon _i 

l^nesl Arithmetic 



24 




27 
18 
14 

6,4 



ExtSndidjpaibt t«iti 

Gri^ 5 Grade 6 Average 

(14) 

(17) 




Representations 08 

^'>*:5.'*v' 

Logic ' _ ^ 

Organ tc at tor^ of Dati* 
Probabijli.' ty ■ 



IL 
2a 



03 



tottl N^l^r of ItaiU 1^ 




/ 08' 



01 



08 
09 

ii' 

09 
15 

05 

%■ 

11 
01 

08': 

.02 I 

i5 



(091 
(16) 

J07) 

(bar 



249 



309 



.424 



Gradee 2, 3. GoSputsaon »a. t^«tl^,epa_r«l3^ fro. MARs te^ ^^-^^^^rcTBS 
atandardUed teata u^^ |n iibh^trlrt. The nu-iber. Uj the tabJa ace for ^e CTBS. 

which w« jia^ ift) tour o£ the aev^n M^^ * _ • 

Gradei % i. TheWaputigJon U»t of _the Stanford Ach. Te^t and^ 

-'^ ^-"^ jjfe. Q 



the MAN^^jitib -in gradflf*;* ^ J r 



C TBS waixe, ihixtrpo 

tlvjdy.^- - - ^* - _ _ _ .-'^^^ ♦ 

Grade 6^." A apecmyrcbnatructed coaputatibn te^ wae.pac< 



the ^NS. 



rhe totat number b-f lte^s I^^ frbi|grade tq grjc5,^ai^e^^ 

use of ^si'femqi^g'lrid' because the oldet stunts 'WQmid^faster. Co^^ 

generally r^me^^t ^jjhasis, though they acGount«l f6f % 
proportibn the sixth. grade MANS beeagfe^of the ine^uslon of the five s^al 
.top categoltes. "fi' 'T- - ^ - ' . 

Standardized/ mathematieB tg§^cBuaHy*have three fectlsns: . 
eoftcifjts, ae^-^word problem^here are separate MANS categ^s^&i computa- 
Udh word problems, feftre is no separae category- fo|; j?br^^^^ 
these kinds of Tttfr.s- occur th^feafpot the remaining categorier.: The average 
number of ite--s In -^e mathematies s^tf^rs of the sevei? leading stan^r^feed 
tests'! Is mmi (a^w.^v^th tRfe\COEre5pondind number of MAJsIS items f«m ftie, 
Extended -Pilot ^Et- """"-v.-^ -i^ 



1-L 



it f|im>utatlbh Itesa 
l^rd MANS 
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TABLE _ _ ^ 

KANS yeSua ^tanilardixed 



Nitftbcr of 0€her Iteaa 
Standard HANS 



iNS Tests ha 
dlz-^ test 



the; ^me 
ee^ to 



1 ^l^e'TBS, tTBS,* Mat,- SAT, ST 




Reliability ; The KR 26 reliability was calculated for each scale and adjustedj 
using .the Spearman Brown forrriula, to get' the KR-2d for an equivalent 2d-Item 
test. Tfie results are summarized below In Table id; . \ ' . 



4. _ _ 
TABLEIO 

. ;^ . _ _ SuBiwry of KR 20«» Across Graaei 2-6 





Total • 


• Average • 


Average 


• KH_20'B 


IKR 20*8 


• KR 20'i 


Category 


Of Tests 




KR 20, > 


>.80 


-75-, 79 


< ,75 


Coomut^tion^ 


6 


\ 

7 


.B2 ^ 


4 


2 , 


0 ^ 




18 


i 


^ .77 


9 


; 5 


4 


;Mcntal Artthnettc 


19 


7 


.88 


19 


d* 


d 


^»J"^^_?«pre9«ntatioqs 12 


9 ' 


.81 - 




2 


1 


Relat ionships 


22 ■ ' 


6 


.86 


19 ^ 




2 


Bdrd Problems 


' 13 


6 


.i6 ' 


11 


1 


1 


fiycidatibn ^ 


- .6 


11 


.90 




0 


> 0 


Special^^Dpics 


' -.12 V ; 


6 


.03 


8 


2 


^ 2 


Ccsinbihed 


106 


7.5 


.84 


65 


13 


'0 



DOe« hdt. tJiS&ja^ •feanaaraized teats ihcdrporated into MANS tests, 

•10 -r- ^• 



6. 



1^ 



dst tests (79%) had. a reliability' of at least\ .80 and only ^^^^^^ (9%) had a reli^ 
Liity of less th^^.75f 'The category with the lowest KR 20's was Estimation^ 
hich Included many myldplfevithdice tests that had short timejimits to prornote 
aiswei" 

eHuftSs of ^ AchI evgment. Table 11 shows cgrrelationl 
ore|^and,Trieasures of reading ability, that were ijsed as 
cbyarlates In ttif jtlata ahalylK. Because of Item sampling^ different students took 
different s*tj^'it0ms| hence the mgdian correlation coefficient acros s different/^ 
fdfnhs iSyr^Dor^g^ ^Tn ' second aid tlWci yrasles^ ,the median across t^^^ 

; or three achie^^Elpit -^es ' : . Z-^'? 



C prrelatidris with 
between total 





^edian Cbrr^ttons Between Total MftNS; 

ani fitar^ardized Te^t Score. I'-, 

^taifdardized . - 



t ahda t dj. zed 
Sadirtg Tests 





^ f^the^atlcs Te'sts 
6 




' to h Iman n i An de r so n ' 
x^Abili-tyJrest 




i 



t 

ERiC 



put^atiiQci 

h Teading §coT^ are very cdosistent^ between .5^^d ,.61 
''CoTr^litions^jwS^ mathematics sctii^s ^iffe^hi^^^^and- 
h high^ 





f - * 

CdrrelatloQS with Teacher R aUng of Stud e nt *AbIU^ In grades 4 and 5^ teachers 
w^re askea Eb raEeTRe mathematical prcSbTerh solving ability -ot each of Jtheir 
/ students, tislhg a 5-point scale. The rinedlah cbrfelatljSl with fetal MANS score was 

•66 In '4th grade and .57 In 5th grade. . , 

• Teac he r Ratings. In fourth. aiid fifth grades teachers were asked to rate Ihe 
\ ^' fnportance of each MAWS Test 'on a 1 t(f 5 scale, where ^1 not Irrportaht and 5 = 

7 \ very Important. Average ratings for each test were calculated^ then these average 

ratings* were averaged fc|r each category. - y 

*There was ve?y^ little, difference between CSMP and Nph-CSMP tepchers' r^rtlrigs. For 
btjth groups, r^fcihgs foil Into four groupings: ' . ) .. / - 

two categt^rles were always rated very highly^ 4*4 or better (Confflfc^ 
' - ^Wbrd Prdblems)^ * ' • * ^ 

four categories had ki average rating of :|j^nd 4.0 (Qrganlzaygn of Data, 
* EstlmatliDn, Number Representations and Mental Arifchmetlc)';^- ^' V '' 

^ ^ Vthl^e categories had a ratlrfgvto^ . / 

Number Patterns, Elucidation jiiil^^^eor^ ^ ; ^ . - .^-^ Z 

oTie category was rated below average in Importance (Probability). , 



- - - . ■ " . . __ 

■ ■, ^' ' ' ■ - , ■ ' -.^v 



Seiii 



}. 



Extended Pilot Tests 






As described earite^l^ in, C^^^ the. dSjN?,,^^ 

:grade was a twoJyear Extended PiMt Test (EP^^ dt Xhe materials, 
first yeap. of the ePT, abqgt^lO - .15 classed ^ school districts 
politan St^ Louis area used the J^^^ curriculum. Teachers were trajned 
eEMREL-cmducted sumr^ vyprk^hops and ma^rials were prbvided C} 
to )participatinq nif^sses^ - E^^^ 

carried out by fioth evaluation and development staffs and student intervi*^^ weje 
conducted. Evaluation Instrjjmente we developed and t^ed at the jersd of "the 'jj''' 
year to-corrpare the performaice of CSMP and No - 
^ Nqn-eSMP classes elected jolntlj^ by_ the evaluatlq^^ staff and the l^ocal districts. 
Thiis the first year resulted in Jpr ell mlnary^ eyjderce about CSMP's effects 
jiudents and potential Iniplenrientatlqn problems a^^ provided the 

W'alqation staff with a cfiance to Sevelqp gnd test a variety of Instrunients' for - 
dse^the follbwj^ng year in the second year Extended Pilot Test. - 

In the seeotid i-y^ar of th^ Exterid^d#iibt Tfests, the program was available to 
\distri56 natiohaHy and^about 48-^ g^sses per . grade level participated. \ Districts 
' trainra^ their own teachers tsuaiiy thr&gh the local coordinator who had been 
traip^l in^'^^ workshop, Aii -dib^if^ts (including those whose ciaises had 

prevIbus^V|artlcipat fjrst^yeaf EPf^ had to purchase nthe matefiais. In 

order tb^participate, d^rljcts jTad to agrpe to harrie a Ibeal cbbJ^ihatdr who would 
^prbvide^ CiSMP-recbmmeWed ¥mbu^ trafriihg fo theiP^t^^ets and would- 
, cbBpeMte irr any data gathering activities (testih^^ site visiC^p^^stibnhaires,^,^ ♦ 
etc.,K In^ practice,': once districts adbpted. the pro^fam, they TCca me fairly^ 
bhbmb&*-aSdi_ prQScara to fit local heecfe. They selected: teichers 

JphTOls_^^hey sSw fit^ trained teachers ih^ways that yvere^ different ftbm 
_ SS^^ReS f less Vexac ting), and cooperated in dajfa ; ; 
gatheflhg &cti^ ir> propbrtipn to .hb^^ the data was 0 theh^^ This was 

.^bdth-^n -^dv^nta^ arkJ a disadvantage f0r the- evaluation ehtefprlSe. ' 

i^Thfei Wicte cvartatiS^ treatment rheait tteafe no single "program" was being'^mpl©- 
.^leiueij'unifotlp?^ since ^iras were widely, dispersed In distant loigjk 

^re of the a^fritatlonsj site 

visits could jpnly. tfe^'ma^^ ' ^"^^ 

mt^ ^jways^etiJJffiedl /on t^e other handj, 1h 
the sites great(^ D worship ^ayec the^pgra 
ations whie:|i would |pe far mpre infofmativi 
ould . &)pe tgil ellr*t Ifidl y^adher^b;^to plan of 
currlculJFn^ pspeciaily the spiral sequencing^ 
the ■pMiher's Gul(te, mad| CS^'^^^Vf)j^l 
classEOTm 1 eyeK Su^ cf^jges WP^^t^ 1 e 
in ^e cfe^ "i^the orogram^cpnitinucd 

asscmed bfiat ^It was^)©i«g taughi,^r^^^ a^£^ 

studenP^^irf^eip c|a 

Qf ^SMP classes was coHnpared - wrth the performance of 
e si^iB^oh bf^on-eSMP classes *te? serva ^ control ^ 
erimental ^on^arisbn _was always a source bffcbhcerh since the ^ 
assignment of teachei^ ar^ students tQ> eorriculVm was hot pbsslble. 
Ihstea^, coordinators wgr^ssked to seleetf^frQ^ sehbols, classes whbse- 

.students and teachers Were as similar as po^Ble^ ta the C^MP classes. 



Jhat 



and 
in pr^ 




iSher logs and questionnaires were 
freedom from Restraint ^gave 
ta fairly natural Implempn- 
CtIng CSMP^ effeets tKan 
en^ntation. Jhe nature of "the 

and the detailed lessorii In 
to change drastically^ at the 
rapid j^mlse of the program • 
ught, it cofcri^safely be 
:ribV 



*pro 



:ent 



The design 
nature. The 




comparative in 
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The CSMP and Non-CSMP classes were very similar In ablllts^ e^^^ year; ' 
cbyariate^^ In MANS a:ores due to differences In ablU between the 

two groups was always small, averaging less than 1 %i there Is an upward trend 
in* dverall ability that by sixth grade^ the median percentile ranks on the 

reading/ score were above 1^. In sixth grade, there are several districts with no 
eSMP classes but some Nqn-CSMP classes. Th[s Is becaiee at^me other 
^disiricts^^^eSMP. was Imiplemented district-wide requiring the use of comparison' 
classes '^om other districts. In every case In which this was done, the other 
district was similar to the CSMP djstrlct^ aid was icing CSMP at lower ^^grades 
(i.e. started later) with Sie Intention of continuing it on a year-by-year basis. 

vSoIat 




Several districts "who h^d begph the prpgrarn a number of years after the pll^ot 
study began, and who were thee, unable tO' participate in the Extended Pj " ''' 
Tests, expressed an interest in conducting an evaluation of CSMP In the! 
districts. GEMREt c^peraEed' in thesle, efforts by supplying and _scorIhg^ 
tests. Local districts *se'lected 'eSMP' and. Non-CSfylP Classes, trained test 
did the testing. 

The MANS Tests tsed in these^ 3oiht Reaearch Studies wer^the tev-ised MANS,^ 
i.e., they incbrpbrafeed the revi^oqs^that were made in afte^the eompjetiort of 
the Extended Pilot Tests in grade5"^-5. The main chariges^^^fere the.foHowirSg; 

At each grade level only twd 'tesf booklets. I.e.,. two testing sessions, ■ wecfi 
roi^ulred. ^ , ^ 

The Gates >1cGIr>i tie Vocabulary Test was ihcbrpqrlted at _each grade level; 



Whole hMf*!b^^ cdmputa^^ were developed fQr each grade based on 

analysis of me major aahdardlzed achievem^t ^fefts;,^_-# 



Through item sampllng^>the total humb^^^ items was increased atv^ll ''^ 
• grades. ♦. ExcJu?Jing the Vocabulary tests, the numbex of i^ems fanged, from^ 

TiS!) (seco^ tb 266 (fifth SE|^e)^ though an individual ^^tutl^nt j«yo 

.bnly do about half of these item^ /: < A i 



Larger numbers of cDmrtion Items ..w^ere included-'an testa, which appeared in' 
conseputlve 'gr'&les. ^ . / ? ' 

^ . ^_/_ __ .. - 

, The directions/wepe simplif ied^ causing the elimination of - SDrne_ hard ;tp_ . 
administer tesr^ A Coordinator .Training Manual was developed anci\^f^m * ' 
fdrmat for the Te^tejr Manuals ^v^^ standardized ^ t;hat loc^I dlstric:;t, coiiild ' 
c^ry out all ph^^s^of>the testlfjpi , r h ' / 

^he proportion of items in each catepo^^ somewhat. ;Each, ofi 

''^he^everuEirq(^& categorlesjvas tested aE^ach gr^de, Relationships 'Sand 

^ ^Nunober JKtems^ mc^t heavily re|xe|ehted proc^e^' rategory^ 

V *^ c(^^inj^^^; average acro^ grades of 22% o,&"th5^Mtems. Word |^robiems, 
-^'^1 J which require the mcKt t|pm pet i|jem to. ad minister, was the leas^'^ 
" ,iL : represerfSM Th^^fcar five process' ^tegories , 

- ^h acc^tinted for betwe'en 1594, and 15% of th^^i^rtiis.^ ) / 
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Corrpared to the MANS tests tJtpd in the Extehde(|' PUdt^Tests^ this ■was 
decrease In emphasis In Compat^tion anelran iherease^iri f=?ela^^^ and 
Nlumtjer fPatterns and In Eluclcjation of Maitiple Answers (the latter incr^" 
due to the fact that Jthls category wasn*t tested_ln fdorth^ grade^prer 
viously). There was one test In Geometry in fofifth ^grade, and_ one test 
each in Geometry^ Organization of Data, and'PKi^ility in fifth grad^i 
none of which accounted for more > than 5% of the^ems, . ' • 




In^^d^tiSr? changes In 

tt^w^'ODint Research Studies 
version of the curriculum/ wl 
^Extended Pilot Test^. 




MANS Tests, CSMP classes participating Jh 
eK:ond or third grade^^^ tsif^ thp final . 
pncorporated the revisions made after the 



Tatyle J3 lists the school districts who participated In one or more grades of 
Joint Reit_arch Studies. Those with ID'S le^_ than 24 alk) participating in the 
ExtentJed Pilot Tests^ LBually providing comparison classes la grade 
since th6ir own Implementation had not reached those gradp levels. y 



TiBI* 13 

P«rtlcip«ttln9 Diftricta, Joint RfMarch Stud^ 
First Bp^try - • ca<P Claa«««, 8«cond Bntr'y*.- lton-<:^ Cl««s«« 



plati^lct 
-Number - 



Type of 
to— unity 



Section of, 

Country 



'J 




I^rge City 
SMll City 

Sabarb ;y 

i^ii city-^ 

,Lar9« City 
Large city;' 




Soburb 
S&all City 



North Centra} 
^rth. Cantral 

Weat 

North Kliat 

North- Cantrai 

cAtral 

South 

Eiat 

North Central 

SaV _ 
Ho^t^ Central 
Nor.th Central 



33&-13 
10-10 
5-5^ 



2-2 
5-4 



2-2 
2-2 

- « 



4- 5 

5- 4 
- 4-3 



21-^6 



5-5 



6-6 



* 2-2 



\ 



> Altogejtier; then, 29^districts pjarticijDated either -t^ ExtendecJ'4=>ilQi Test or JouhV 

Rese^tn'Studies. £jeveh of these v^ere subia^^s^ Severi wfere ^a^cM^s, six^ 
..• l,ar:ge ^itiek'and |i^fC^re meCfifciTi cities. Tfiere were eight S^lftS^^jro'^"^"^^ 
^'j'the Gentral, North tehtral i<i^d--f;a^^ parts of the country,^ 



I 'f rem the West .'and two Trorriv the 
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;Argij>sI^gf/cia^ Mean Scpres on T dtal MANS 



"•This chapter defscjibes^ ^^^^^ scores. Except for the Extended Pilot 

Test at» secondiand thir thi§ Total score Includes Gonyatatioh; In the next 

chapter a categqry-by^category ail»lysls will be presenlea"^exeepfe for/feorrpatatloh, 
which will be deferred to the following chapter)* > - 

• ■ ^ i 

Jhe prlnnarj^ method of analysis _tHF&u^OLft Extended '^'^t Tests was ah analysis 
of covarlance on class means- For score waSealcalated for both 

the M/^S ^d_ a Reading or Vocabulary T^st. In cases of Item sanrpling, aveFages^ 
were computed by adding togethef the .•average score oh each , half of the ^est. Then 
a one-way ANCOVA_ was carried out td cdmpare CSMP and Non-eSMP classes, using 
Reading or VocatiUlary score; as a cdvarlate. : 

In secOTd and third gradesi dlfferfeht tdyariate.me^ t^ed in different sites 

(kuhlmann Anderson Test of Mental. Ability, CTBS Reading Gomprehehsioh, BTS ^ 
Cooperative Reading Test, anU Stafford AChlevemjeht Total Reading). Thus^^eparate 
analyses were 'carried out for each district, and will be reported in the grade-by-grade 
analysis in the following* pages. In dfder tb ajmmarize farther for each grade, second 
and third gr^de classes, were cohvenrte^ a cbmrheh metric asing equipercentlle 
methods^ ^d a single Analysis^ of "covarlahc^ p^^rmed. 

In fourth t^irough. sixth gra^^^ was'baHt into the h^^S tests ^ ' 

that, ail districts u^ed the same Reaafrrg_ or Vocabularyj Test. The testVused were ^h&i 
Stanford Achlevemen| f=^eadlhg Cdrfiprihenslon, the GTBS Readinc eompfehehsioh and 
the Gates NiicGinltle Vocabulary, respectively, for grades * 




Pilot Test data given below, grade- * ^ 
est »^d 3eint ResearcJi $tady data , will beJ^ 
eans on 'the Tei^al M^NS* sepre. 



^ Following the brjef_summary .^f Exti 
by-gr^de .^alysls of both ExteflS^ ^ 
preseqte^, together with graphs of c 

TableM^ summarizesjJSt^^^^ .P^^ ^^^^ at i^ch grjde 

leveL. The adjusts '^9^_'scoTe%,vv meah^OTe acro^ all 

J cSMP tlasse^ and across all Non-G^FiF^^ two mejns 

for differences In i^^eadlhg or Vbcal^lary^ Theadjdstmepts v9Se always small 

because the grbUps 7were well matched In Reading or Voeabalary sco^e. 




_ t,We U - ; , 

Sui^mary D^ta of Tot^ mJtNS Scores^ 
Emended d|B||^ T^ts --'"'^ 

st^ Mean MftNS ^6if £/sP 
MP Non-^r^^"*" 




.41 

.51 ' 
.6&^ 



.04 

.02 



•* ^ . 0'1 



, 2 Cbvai'rtnce'T-teBt wlSth 1 ii^ 28,30 d.f . ^iecbnd grad*) ind " ' 
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TaBle 15 shdwl the average percentJ Correet^Seros^ all items, ;totained._sirT?)l^ by 
divldihq the adjusted means from the previous table .by the ^o^Sl of_ 
items. Also shown i^ the percentile r^k e3|€espGhdihg to i|e..mean Reading . or 
Vocabulary score. ; . 



Table 15 

Average P^cent Correct on "i^l ^Ni Iteifis 
By Grade in £xt*hded Pilot /t^sts 



Grade 



Cbvariate Percet 
CSMP Ndn-C£ 



te Rank 



2 
3 
4 
5 
6 



56 
55 
64 
61 
77 



54 

55 
%2 
60 
78 




Average Percfht Correct on MANS 
CSMll Nbh-CSMP 




The dif f erenee is' temarfeabl/ constant across year^, ^ways between_ 6 
favor of eSMP elases. More items were answered mrreetly Iri thej^ 
this ecxisistent with the higher ability level of parSeipating studeht 
grades. ' j. 

Second. -Grade Totat MANS. ^ • * ^ 
y f " . V V 

Table 16 summarizes the secohcf' grade results_on a district-by-dis 
the Extended Pilot Test and t;he Joint Researdi Studi^f^ The^^res f^^^ 
Reseac|i Studies are higher because there were more items^ in-these revised MANS ^ 



Tests. 



sSJuSrir of Secoha Cr«d« MANS ^ 



Total MANS Seore 
:^ CSMP len-csMP 



Jajui?«a Mea^a Signify 
fcSMP Nbh-CBMP • at .05/ 



E)iten<iJe<3l Pilot Teata 

3 f^^II Ctty, Central 
21 • Small City, Eait 



6 SQbur'b, Central 

12 ' Suburb, Central 
18 ^^dburb, CijhE.ral 
22 L«r9« Clty^ Central ,^ - 

4 Large CiE]/, North Centcal 



15 




'54.2 

46irCI 



41.6 



-48.5 
33.6 

- ^ 

35.3 >^ 



41.5 



Joint Research Studies 

2 




j>te^iu» City, Weit 
S«all_City, North CJtr^ 
HedluB City. N Qfth ^b#i 

SnAll City, West 
Sna llClty.NorthCentral 



3 
2 
26 



112^0 
-111.4-^ 



Sybdrto,* North Central 

Mediui City, Weat 
liaf^e.^lty. North Central 
Large City, Sooth * 




5 5 , • ^511^1^:^? 

2 ' **^3.7 • 70p 

10 62.2.^ — , 57..6 

4 52.7. 44. J 

y -:si.^ni£icant, N J. N6^ ^htftcaot^ N^A^- too few p^es^for 
Analysis of Covariance on dassV^er-^ 
2 Upper track students. 



10 



T 



MA 



>plication 



' Y 
Y » 
SA 

N ■ 
N 



86 



'1 

95 BESTOTYAV&DLE 



Altog^ther^; ther^ ai^e 1_3 coniparisons in the tablej 10 of whi cli had enoLfjgh clgss,^ 
[n>5) to re^qnably; carry out an Analysls^of cwariance- ^Sevea^prgduced si^^/^^ 
ni f i cant dif f erer^es-H^^^ox. of C S MP^ * The I'tiWier- wef e f r om 
large urban dlsb^^'m^^^^ below* ay^ra;gip^aW and 17)? The 

Joint ResearcFi slfi^ag-froni t^ two'^dfstrlcts pr'di^ced CSMP advantages of 8% 
and 17%, but_ vver^H^ Wide variation: In sctfres* 'this 

vyill* be illustrated after the presentation of Wrd grade results. 



Another statistic that can be used to compare perforniarice_^^^ of 
Items answered- each study Is weighted equaliyi the meal percent 
correct In the^^^jye^ided Pilot Tests was 53 for OSMP classes versus 46 for v; 
Non-GSMP; In rthgYJcJlnt Research Studies the percentages were almost the sarh^, 
52 versus 46. i <i 

The graphs below show the performance of each partlcljiating class. Each class 
is represented by an entry on the graph^ "x" for a CSMP class and "i" for a 
N5n-CSMP class. Horizontal position on the graph Is determined by Reading 
score; the farther to the, right - the higher the average reading Icpre of the 
class. ^The vertical posit Ion is determined by Total MAN^ scbrei the farther Up - 
the higher the average MANS score fdj: the class. The regression line which Jias 
been drawn on the graph Is thB besf linear prediction of MANS score for a giveri 
Reading score. ^ : ^ 



Figure 6 shows Qlasi theahs from' the' second grade Extended Pilot Test, two 
l^raphs are heedid becatse half the classes took one. set of test3^ Booklet A, and 
the other h^f took different set of tests, Booklet B. ^ . 





EKLC 



Figs 6. Second Glass el 85^ tvfeanSi • /° 

i \^ Extended ei lot' Te?t^ • • 

Booklef A (left) and. Booklet B '^i^^ J 
(X = ^ivpeiass, • = isibn-' 



87 



9% 



•f^igure _"7 shows mean scores for aJl classes which have participated in Joint 
Research Studies. 
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Fig. 7. Second Grade Class Means ^ 

Joint Research Studies 

- * (X ^ CSNf^CJasSj 1 = Isbn-CSNP Class) 

Third -G rade Jto ta ] MANS. 

Table 17 sammarizes the third grade results of the Extended Pilot Test. 



Table 17 

Suiiinary of Ttiird Grade HANS Resulei-« 
total fMans Score ' 



Dtser tec 



Descf tpt ton 



Nuinbef of ciasBes 
CSMP Nbh-CSMP 



CSMP Nbri-CSMP 



Sign! f 
at .05^ 



Extended Ptlot Tests 



21 


Small City, Cast 


6 


12 


77 


. 1 


67.4 


6 


Suburb, Central 


4 


\- 5 








12 


Siibur b. Central 


4 


4 


"72 


7 


65.0 


22 


Large City, Central 


3 


3 








20 


Steatl City. South 


15 


12 


< 58, 


;2 


54 ; 5 


1 nt Research Studies 












24 


^ HedluiD City, East 


4 


3 


151 


6 


125.8 


1 1 


2 Small city. North Central 


4 


5 


145 


2 


116.9 


1 (82) 


Hedium City, North Central 


20 


26 


122 


8 


106.2 


1 (83): 


Medium City. North Central 


33 


13 


119. 


7 


11D.3 


26 


Suburb. North Central 


2 


2 


114. 


7 


93.1 




Large City, North Centi al 


13 


6 


90. 


3 


82.5 


17 


Large City. South 


5 


4 


71 . 


5 . 


6B.0 



y: 
Y 

Y 
Y 

NA 

N 

N 



Y. " Significants N. • Not Siginificant, NA "too few classes for application of 
An&Iysi£ of Covariahce on cla^ rrieare 
Upper tracker gifted students. 
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Altbgetttfer there are ID |gjr»parlfens in the table. Six produced significant dif^ 
, ferehces all In favor dfii^M?tanS^bhe had too few^classes to test for 
sfghlfieaheei ^ * % -)^s^/ ' ^ 

The average percentage of -dterps '^s^^ered correctly (obtained by average Jcrbss 
stadies) was 52 fo^ CS\^P foj fslon-CSMP In the Extended Pilot Tests 

and 68 versus 52 in the Joint 'F^e^earch Studies, The higher percentages correct 
in the 5oint Research Studies jYi'tioubt reflect the fact that In two of the eight 
distriets, upper track or glfttJd stiJdinU were tested. 

Figures 8 shows third class meaH| fr_^ the Extended Pilot Test. _Most classes 
took tbth test booklete^ but In one district^ ^ the classes took Booklet A and 
the other half took Booklet B.VHenc>e^ all classes cannot be represented bh a 
single graph. - - >^ 

i 





Fig. 8. Thi rd Grade Clas^s tvfeahs ^ 
t Extended Pilot Test 

^ ^Booklet A lleft) and BdokIet_B (right) 
(x = C3^ Class, 1 = Non^-Ca^) 
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Figure 9 shows the rheah scbr'es for all third grade classes which pa:ticipa*:ed in 



Total MANS . 
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Fig. 9, Third Grade Class Means 

Joint Research Studies 

(x = eavP Class, t = rsbn-Ca^^) 



3 

For ^1 of the data reported thus far for either second or third grade, Including 
both Extended Pilot Tests and Joint Research Studies, there were only three 
districts in which significant differences in favor of CSMP were not found 
(excluding districts with too few classes to properly perform the analysjs). Two 
of these districts were Districts 4 and 17, both large city school districts. It Is 
instructive to look at graphs of class n-ieans for these districts; two such graphs 
are shown below. 




Jht-,,H fKiurt'i. tjoti) t>how that CSMP classes perforrried better than Nbh-CSMP classes 
ftvtrall. But t)Oth figures also show One or two extrerhely high scoring GSMP classes 
yr^uch higher than all other CSMP classes) and one or_twb law scoring eSMP classes 
slower than aii Non-CSMP classes). For theHsipn-CSMP classes, MANS scores are 
predicted qbite well from Vocabulary scores. None of the Non-CSMP ciasses, 
however, did particularly well or particularly poorly in relationship to reading score. ' 
If a regression line were drawn through Non-CSMP classes ^which aetuaUyJs the case 
in the first figure), most Non-CSMP classes would fall close to t^at line: — 

This* inconsistency of CSMP performance, with wide dispersion from the regression 
line (i,e., anpredictability very different from what is usually obsftved. Ordi- 
narily^ there are occasional outliers, but most CSMP classes fail fairly close to their 
regression line. Not enough Is known about the implementation of .CSMP in the 
aberrant Clares of these two districts. However, in both districts, coordinators were 
able to nanne the teachers of very high and low scoring classes before seeing the 
data. The reasons given had to do with teacher attitude and extent and quality of 
KT pi ementation, though how much these were related to general teaching ability 
rennains unknown. 



Enurth-Grade Total MANS 



Table J8 sufrinr.arizes the fourth grade results.. The Extended Pilot Test results are 
given in a single row. There were several districts with only a few participating 
classe5,tlxis a single Analysis of Covariance wascomputed for the entire gr^p of 51 
classes. Classes from nine districts altogether were represented and these districts 
were listed earlier in liable 12. 



_ _. Table 18 
Sirnmary bf_Fourth Grade MANS Results, 
Total MANS Score 



District 



Descr iption 



Number of Classes 
CSMP Non-CSMP 



Adjusted Means 
CSMP NbhHTSMP 



Sighif 
at •05' 



Extended Pilot Test 
* - 

Joint Research Studies 



3d 



13 Large City, Central 6 

1 MediuTTj^ity, North Central 23 

9 Suburl^ North East 5 



21 



6 

23 
5 



145,3 127,5 



168.1 145.3 
158.4 141.2 

158.2 ' 137.7 




Y 



100 
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Figures i 2 and 13 show fourth gjrade class means frbnn the Extended Pilot Test _ 
and Joint Research Studies respectiveiy. * f 





Ei ftb- and Sixth Grad e Total MANS , 

Only a very few classesjn fifth of sixth grades have partlcifDated ih /3diht 
Research Studies, (the Extended Pilot Test of sixth grade was only eompleted In 
1982, and these_ isolated classes are hot reported here.) Table 19 gives sammary 
data from the Extgftded Pilot Tests at these grade levels. 

Table 19 

- summary of Fifth and Sixth Grade MANS Results ' / 

Total MANS Score 



Graded Number of Classes 
^ ' eSMP Non-CSMP 



Adjusted Hearis 
CSMP Nbn-CSMP 



5* 

6 



193.9 
290.0 



177.2 
263.7 



31 
26 



25 
37 



Sign if 
at .05 



Figures 14 and "15 show graphs of class means on the fifth and sixth grade Total 
• MANS. r 




Fig. 14. Fifth Grade Glass fvfeahs 
Extended Pilot Test^ 
(x = 03^ Glass, i = NDn-^^vp) 



Fig; 15. Sixth Grade Class N'feans 
ExtenQed Pilot Test 
(x = C3vP Class, • = rtn-CST^) 
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Analysis at the School and District Level 



At fifth and sixth grades^ analyses were carried out Lsing school and district as 
units of analysis Instead of class- There was ver^ Httje difference 
results compared to the class level analyses reported earlier. In fifth grade; for 
example, the t-statlstlcs for differences in means were 4,5, 4^8 and 4.1 for class, 
school and district ievel_analyses- r.espectlvely, all significant at .dl- The school 
data were based on 12 CSMP and 12_ Non-CSMP ^hools and the district data on 
6 CSMP arKj 6 Non-CSMP districts*. (Most of the districts contained both CSMP 
and Nbh-CSMP schools, but rigne of the schools contained both CSMP 
Noh-CSMP classelj r ' 

The sixth grad^ data are shown -in Figures 16 and 17 below. Figure J 6 shows / 
school means; each entry on the graph represents a school. In Figure 17, each 
entry represents a district. ' ^ 




Fig. 16. 6th Grade Schdd'l fvfeans _ -Fig. 17. 6th Grade Dlstr ict Nfeans 

(x = C9^ school, i = Non-C^vP) .(x = CS^p district, • = N3n-G9vf^ 

These higher levels of .accumulation tend to stabilize .MANS^ores relati to 
Vocabalary score. In Figyre 17 for ekample,^ a regression Ih^^ 
Non-GSMP districts would predict MANS scores very accurately; all: districts 
would be very close t_o the line. The CSMP districts were also- fsdrly predictable 
except that ope CSMP district did very poorly^ and ^vas farther jDelow the regres- 
sion line than any other district. ; Ih thai district^ one schbol, containing two 
6SMf=^ classes, participated in the. testing. Not enough^ is knovvn about the 

.circu^Ti stances of the implgmentatidrr-in that district to explain this finding. The 

'•'coorsinator was hot /greatly surprised by the -r^sulis and/ though^^ 
Glasses t^en In the lower grades -wourd do much: better when they get to si^t^h 
gr^e fc^.an tl^e present grojp. ' * ' 
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^'Strict level graphs from the fourth _and fifth grade Extended Pilot tests are • 
s'^.Qw.^.-bejow In Figures 18 and 19.. Oixe agajhj.the data are more stable when 
district rneans are usee. Also, In foufcth grade, It was again true that one CSMP 
district (a' aifferent one than) in sixth grade, but also one with relatively lower' 
ability students) did not perform as well as other eSMP districts; 

/Ik Total MANS 



Reading 



Fig. 18. Fourth Grade District Msans 



Tbtai MANS 




Reading 



(x = C3vp District 



Fig. 19. Fifth Grade^l strict Nteans 



(x = C3vP District, i = Noh-C^v^) 



Student Level Analysis 



At each grade leyel^ students were tiivldpd Intojour' or five groups according to 
their reading o^ vocabulary score. National norms were used to determine these 
groupings. FOr each such group, an average total MANS score was calculated. 
These means scOres are plotted, separately for CSMP and Non-CSMP students, in 
Figures 20 to 21 below. The first two figures are slightly less accurate because 
a separate reading, score was not calculated for each group. Also, in Figure 20, 
the graph points were determiined by addirig together the separate totals frorn 
Booklets A and B, each containing different tests, with classes randomly asslaied 
either A or B. . - 



/ 

Total HANS 
Percent Correct 




/K Itotal MANS 
-^Q i . Percent Correct 



55- 

t|<)- 




Reading 



r 



Fig. j20. Second Grade Student 8^ans Fig. 21. TTiIrd Grade Student t^^s 

Students grouped by readirg scor? Students grouped by reading score 

(x = G3vP Students, • = Non-CS^) (x = CSvf ^Students^ « = Nbn-e3v^) 
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Percent Correct 



lo- 



ft - 




Reading 
— ^ 



Total MRUS 
Percent Correct 




Fig. 22. Fourth Grade Student Nteans Fig. 23. Fifth Grade Student N€ans 

Students gr Duped by readying score • Students grcuped by reading sc or 

(x = GS-P Students i ■ = NDn-C3^) (x = e9^ Students,^* = Non-C3^ 



Total MANS 
Percent Correct 



70- 




Vbcabulary 



Fig. 24, SIxtb Grade Studfent N^iis 
* Students grouped by readi 
. ^(x = C3^ students, % 



ng score 
Nbn-GS^P) 



the results are very consistent; CSMP students outperformed Ndn-GSMP student* 
at every ability level in all grades. The largest differegjces. occurred in fourth 
grade, it was sHowh previously that from analysis of class means, the largest 
difference In standard deviation uiits was also at fourth grade. In fifth and sixth 
grades, the di'fference in perfdrmance at the lowest ability level is smaller than 
at other dbllity levels. • ' " • 
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SUrnrhary . 

The MANS Tests were ari attempt, to assess some of the anderiyihg thinking skills 
of eSMP without overtly Using CSMP representational languages or termjnojogy. ,v 
The usual emphasis on computatidn and word prbblen-.s was' drastically reduced so -r 
that tudents could be presented with a wide variety of often- unfamiliar situa- 
tions requiring somie matherriatlcal .application. The tests contaihed many 
"problems", though most of the MANS items; were not "problem solving" in the' • 
strictest sense, nor could any pap^r and pen^pil, group-administered test qualify in 
that, sense. But the MANS tests were closer to true problem solving than most 
standardized achievemient tests in mathennatics, and they tarned out to be a 
rather valuable, frequently used^ product with potential use independent of CSMP. 



The original MANS tests were administered to at least five districts and 50 
Glasses ir^ each of grades 2-5 during the formal OSMP Extended Pilot Tests. The 
revised MANS were adrTiinistered in ^13 districts to over 30D- classes in subsequent 
Joint Research Studies, which were cooperative ventures between GEMREL and 
the local district. CSMP and Non-CSMP classes were comiparabJe in abifity as 
meaaured by standardiz^J reading and vocabulary tests. Similarly, schools were 
comparable, usually fron^ the same area with similar teaching staffs. Class rr.ean 
scores were analyzed using^halysis of Covariance oh the class me^s, with 
reading or vocabulary scores as covariate. n^' 

The results leave no room for doubt. CSMP stuSents^ classes, schools and 
districts performed better than their r\Jon-CSMP counterparts. This liappened at 
all grade levels, for all ability le\^els, and in every kind of schodr. Looking at 
graphs of class means becomes a repetitive exercise. It is this consistency of 
results which leaves no doubt that something, happened and that CSMP caused it. 

The i/Tiportance__of thi^ overall finding, the educational significance^ depends oh 
how big the difference is and how xriportant the abilities being tested are. 

Consider the student level effec_t size, i.e., diff^ence jn scores divided by ' 
standard deviation. At sixth, grade, this was .3Traw score standard deviations. 
On the five Jeading standardized tests for which this, data _was available^ an 
-increase of 1/3 of- a raw score standard deviati^ corresponds to *ai improvement 
from the 50th percentile to ah average of the 6Tst percentile, and from the 75th 
percentile to about the 85th percentile. 

If one translates all results into simpfe percentage terms, the gain Is from* the 
56th to about the 63rd percentile. 

The size of the CSMP advantage on the MANS Tests ^s also roughly comparable 
- to two findings of national significance. First, the 4D-pointrdeeline in the 
. Mathematics^ section of the Scholastic Aptitui^e. Test, from .1953 is equivaient to 

about 5 items on a 60-item test^ or. less than 1/2 of a raw ^ore standard 

deviation. 



Second, the "most salient finding" of the recent National Assessment of 
Educational Progress, in m.athematics, was that "l^-year-olds have improved * 
dramatically between 1978 and 1982" (the improverrient was about 3 pircentage 
points) and that »»of particular significance is the 8 percentage point gain for 
13-year-olds in h^QvHy minority schools." • , 



thus C;h>MP mivaritage oh t^ie MAN^ Tests is an _educatio:nal.ly_.sig 
result in Itself but-q^riore so because of the nature of the MANS Tests which are 
based on applications of rnathematics to hovel situations. Also described, in the 
1983 National Assessment Report is the difficulty of making Irnprdvements in this 
area: - 



"Witii one exception, there was very little change in prdblerh SDlvj 
* perfonfiance betv^een 1979 and 1982. _ The one exception is that 13-yearrOlds 

showed significant growth In solving routine probjems - i:e.^ word problems 
of the type usually found in textbooks and practiced In school. ..Most of 

the routine verbal problems can be solved by mechanically applying a 

computational' algorithm_...Even the 13-year-olds^ who made slgnjficant gains 
on routine problem solving, showed no change In their perforinance on 
non-routine problems." " ; - 

The CSMP curriculumi is a derhbnstratidn that such gains are possible. 
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V. blUULNI ACHIEVEMENT: iNDlVlDOAL MANS CATEGOR 



Results from each eate^^ wiU be presented separately. The tests T 
category will be r^viewffrf with sample results. The results will be 
frrirri the Lxtended Pilot Tests, except for a few graphs of class meai 
Joint. Research Studies which wlU be used to Illustrate certain finding 
addition, results fronv individually administered tests in third and fouri 
will be described briefly at appropriate places; Between 100^ and 150 
the St, Louis ar^ea were tested on an Indiyidual basis, during the Exte 
Test, using more extereive and open ended formats than were possible 
setting; results are de^i^j-ibed more fully In Appendix G, ■ 

Before presenting eategory-by-category results, a brief overview of th 
all categories will be given. Table 20 shows 'adjusted class means for 
Non-eSMP clashes at each grade. -The means were derived In the usu 
computing a mean category a:ore and a n.ean reading or vGCabulary s 
ea:h class and then performing a one-way Analysis of CovarianciB of I 
a.eans; 



Table 20 

Adjusted HeanB. MANS Process Cate96rleB 
(FirBt entry • CSMP mean. Second entry • Non-CSMP) 





\ 






































Grade 


2 




Gr 


ade 


3 




Grade 


4 




Grade 5 




Ee t Ijna t ion 




4 


.4 


4 


. 1 


16^6 


15. 


4 


22 


.9 


21 . 


. 2 


28. 


.5 


27 


.4 


Mental Arithmet 


ic 


13. 


.? 


1 1 , 


.0 


1 1 - 


9 


?. 


4 


22 


.2 




.5 


26 


. 1 


21 . 


•3 


Noiub^ Reps. 




5. 


:6 


4 


.5 


3. 


3 


3. 


0 


13. 


:3 


12. 


. 9 


30 


.0 


27. 


.7 


Relats. k Numb. 


PattB. 


9. 


.9 


9. 


.2 


24. 


2 


2 1 . 


2 


32, 


.2 


23. 


.7 


15, 


.6 


13. 


.4 


»- -» - 

Word Problems 




A, 


.3 


4. 


.ON 


5. 


3 


4. 


8 


1 5. 


.2 


13. 


, 1 




. 1 


12. 


.2 


E iuc idat ton 




1\ 


:4 


6. 




5. 


9 


5; 


8N 










16. 


:3 


13. 


;3 


b' , 
Total 






,5 


39. 


,6 


^7. 


2 


58. 


6 


105. 


,8 


90. 


,4 


fl30. 


.6 


1 15. 


,8 



"N - Not significant; all others sigriiflcarit In favor of CSMP at :05 on 



A total of 29 out of the. 33 comparisons in' the above table prpduced ; 
differences in favor of CSMP, In the other six comparisdns, CSMP cli 
hiaher miean scores, but the differences were not significant. 

\ _ _ % 

In Table 21, below, the numbers from , the previous table are tr^nslatec 
percent correct to allow a com.rriri basis for comparisdn. 



X' 



^Table 21 
Adjusted Mean Percent ; Cor r ect . 
MANS Process Categories. 
(Fir'st entry - CSMP. Second entry - Nbn-CSMPj 



Gr . 2 Gr . 3 Gr . 4 Gr . 5 Gr . 6 Ave rag* 



Estimation ^?r^2 50-47 55-52 62^60 61-56 52-49 

Mental Arithime tic 58-4 6" 48-38 62-54 62-5 2 68-62 60-50 

Numb. Reps. 62-50 41-38 49-48 S4-59 72-66 58-52 

RelatB. N^rab. Patts. 52-48 64^56 " 66-48 .68-5i9 7<-6^) •^^'^^ 

Word Probiems 54-50 53-48 58-50 JO-S 1 66-59 58-^.2 

F:ijcidatIori 53-49 49-48 65-53 65-53 58-51 
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Mental Arithmetic and Relationships and Number Patterns, _were the categones 
with largest CSMP advantage, an average of 10 percentage points _in each case. 
This difference translgtei into about 20% miDj-e correct . answers for CSMP classes 
than for Non-CSMP classes^ Number Represehtatlons, word Problems, ^and . 
Elucidation produced average differences of 6. or 7 percentage pointSj^Ke., about 
13% more CcDrrect answers. EsUmation was the category with the sri^lest ^ 
differeHbe, with an average difference only about 3 percentage points; 

□rdinarily, these average percentages' would be somewhat deceptive since they are 
unweighted. Categories with a disproportionately small number of Items in t^^^^^ ^ 
lower grades may have undue Influence. But In the previous table, the average 

percentages reflect the findings at each grade levej fairly well. In only one 

category. Elucidation of Multiple Answers, were the findings very different a;ross 
grade levels; the differences were quite small in second and third grades, but 
quite large in fifth and sixth grades. An explanation for this discrepancy will be 
given vvhen that category _|s discussed. 

A third way of looking at the ^ta is to corripare the difference in adjusted class 
mean scores with the standard deviation of the class means. The results^ are _ 
shown in Table 22, below. For second and. third grades, data is from 107 and /5 
classes respectively, which participated in 3oint Research Studies. This was 
necessary since relevant ^ta from earlier Extended Pilot Tests are rot available. 



Table 22 

DiffetencM In' M jus ted He.n. In St.nj^.rd Deviation Unite 
/ MWJS Process CSfegortes 



MWJS Process CSfegortes 

Gr. 2 Gr. 3 Gr . 4 Gt . 5 Gr . 6 Average 



EstiSaflon "'^ 'g'^ 62 

^^^^"^^'^ !31 ^36 -18 ^43 .36 



.54 .26 .42 .43 



Numb. Reps. 

Selat.. * NO... patts. .J| -J* 
word ProMe-s .?« -2° • 

Elucidation •'' 

The largest effects again were In Mental ArlthmieUc and in Relationships and 
Number Patterns, where the difference was usually 1/2 to 3/4 of a standard 
deviation. The averages given for Elucidation and Word Problems are somewhat 
deceptive; the effects were relatively small in second and third grades and 
relatively large in fifth and sixth grades- i 

A fourth method of comparing results across categories is to look at individual 
tests within a category and simply count whether or not the test produced a 
siqhlficant difference. Agiin the two- categories containing the highest proportion 
of significant tests were Mental Arithmetic Q7 significant results out of*20 tests) 
and Relationships and Number Patterns (16/22)^ Tests in each of the other 
categories were significant about half the time: EsUmation (9/18), Number 
Representations (5/12), Word Problems (8/14), and Elucidation (3/6). 

The rest of this section will deseribe findings in each category except 
computation, which will be described in the next chapter. 
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CSMP classes scored significantly higher than Non-CSMP classes in the N/,ental Arithmetic 
cucsory at each grade ievel, and the differences were fa..iy consistent. Across all grades 
ana test iterris, CSMP classes had an average of 60% correct versus 50% for Non-esMP- 
a-id 17^out^of^20 tests .in this category the difference was significant. Figures 25 and 26 
Illustrate the findings. Figure 25, which shows third grade classes on the revised MANS" 
is a fairly typical result; the differences are large and obvious between eSMP and 
Non-CSMP classes. Figure 26, sixth grade class means, shows the least in-presslve results 
or any grade level, mainly because of the very poor stowing of a few eSMP elates- 
nevertheless the overall results still clearly favor CSMP by a large margin 




Mental Artthinetic 




^* i ,^^^f Jiff '^^"^ ""^9- Sixth Qrade Class h^ans 

fvEntal ArithTietic Ivtental Arithr^tic 

Joint Research^ Studies Extended Pilot Tests 

(x = C3VP Classes, • ^ Non-C3^) (x = Qs^ Classes, • ^ Non-CS^) 



" wholeNumber Open Sentences. Eg_._ 9,00J . ? = 9,100. Doing scratch wdrk 
ThSTF^y ^'Scouj-ageo or prohibit ed; students had to^figure out these problems In 
their head.^^The box o be filled in could be on either side of the equal sigh. 
The computational requirements were not heavy. For example, a problem like 
/ X 63 would be inappropriate because the emphasis is on computation and 

' ITrnm""^' 3nd^Pf t|f J results nr,ust be retained mentally for ' later processing. Most 
problems contained numbers which were multiples of 25, 50 and 100 so the 
arithmeUc Itself wasn't hard. But determining what operation to and how to 
use it As not easy far elementary students. For examiple, only 71% of the fifth 
grade CSMP students and" 58% of the Non-CSMP students gave the correct 
answer, 99^ to the apparently easy example given above. 
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At every grade level, CSMP students had significantly, higtler scores. on this test^ 
and the_ differences were large, ah •average bf__ about 60% versus 51% correct in 
favor of CSMP. In seccrid ahd .thirti grades^ CSMP. students' superiority .carr.e 
h-ibstly. frbnn .itenns involving jrUltiplicatibh br cbhtaihihg larger. .numbers (for 
exarhple, in the hundreds). This result is unsurprising given CSMP's early 
erriphasis on thp^ cbhcepts. 

In grades 4-6, however, CSMP students continued to do better with problems 
involving multipilicatipn; they alsb_did_better when division was required. This Is 
very, interesting consjderihg that CSMP students do hot do particularly well with 
straightforward multiplication and division problems^ especially those involving 
algorithms. , Consider the two results shown bieldw. 



6/ 12,0CXJ C3vP: 73% correct 
N3n^^C9vP: 79% correct 



800 divided by ? - 200 



C9vP: 



60% 
45% 



Below is a list of a few typical items on which C$MP students 'did particularly 
well (grade levels are shown in parenthesis)."^ 



X 2 = 8 (2) 



50 + 150 



(2) 



2 X 400 



(^) 



35 



65 (2) 



3 X ' 125 = 



(3,4) 



525 - 



225 (3,4) 



525 



225 (3,4) 



125' = 250 (3,4,5) 



25Q = 566 (4,5) 



500 ♦ 2 =r 



(4,5) 



4,999 



10,060 (5) 



so 



-11 X 273 
22 X 273 



3.003 



(5) 



250 



150 (5,6) 



f 20 



= 41 



(6) 



(8 X 29)+(2 X 29) 



(6) 



SO 



12 
13 



X 
X 



75 
75 



900 



(6) 



Fraction aid Decimal Open Sentences. These tests were sinriilar to the whole 
nuTfiHer'EfsIs^'Txc'ipriTiat Vney TnvoFed fractions or decimials and appeared only 
in third, fifth and sixth grades. On fraction open sentences, CSMP students had 
much higher scores than Non-CSMP students in third grade (30% correct versus 
35%), and significantly higher scores in fifth grade (53% eorfect versus 43%). By 
sixth grade there was virtually no difference in scores. Items on which CSMP 
students did best were: 



1/2 X 
i/2 ♦ 



10 
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ih^^d grade, a similar scale was used\ consisting of Items requiring the_calcuia- 
Hd^t)f 1/2^ 1/3 of 15 = ? or 1/2_ of_ ? 

= 16^ CSMP classes did nriuch better than Non^CSMP classes (ah average of 50% 
correct versus 35%)^ this_ finding reflects CSMPs early emphasis dh the (Darti- 
tioning aspect of fractions. 

Decimal open sentences appeared only In sixth grade^ with CSMP students scbririg 
much higher (78% versus 6096) than Non-CSMP students. Typical Items were: 



0.75 



= 0.5 



and 



25 



2.5 



^ /a Hits and Mi sse s. Students had to determine the missing pieces of infor- 
mation TnTRe^"aHaHo^^ bejow. (purJhg testing, the game was carefully 
explained, with samples problems, and a thermometer-like scale was available for 
use on the student page.) 



Started with 
score of 



Each Hit 
Gain 5 points 

Nurber 
of Hits. 



f 

Each Miss 
Lose 1 point 

isbmber 
of misses 



Ended with 
score of 



0 



1 



1 



Some form of this, test was admiihistered In each of gr_ades_4-g. The sixth grade 
test was more difficult because each misS cost two points Instead of one. At 
each grade there was a sighlflcaht differehce lh. favor of 'CSMP classej. who had 
ah average of 65% correct answers vlrsUs 54% for Nbh-CSMP classes.'^'he scale 
involves the concept of negative numbers, but this alone does not account for the 
difference. For example in both fifth and sixth grades, one of the jtems started 
with a non-negative scbre^ with rxi hits and a number of misses sufficient to _ 
make the ending scdre negative; in both grades identical percentages of CSMP 
and Ndn-CSMP students got the item correct. ^ 



The CSMP advantage was greatest on items in which the rplsslhg informatlbn was 
something other than the ending score^ as shown in some typical examples below. 



Started With 



Hits 



Misses 



Ended With 



3 below zero 
10 below zero 



2 
? 
1 



d 15 below zero 

2 5 above zero 

? 12 below zero 
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Hints and Pfoblems. in this rrioderateiy sjDeeded third grade test ^ students were 
,g!ven"pairs of related addition or subtraction prbblems._ The_.ariswer to . one of the. 
pt-bblems was given and students had to ase that answer _tb figure out the arewer 
tb the bther problem^ as In the example given below. (Students were discburaged 
frbrf. trying to use an ajgorithnn to caiculate the answer and were not given much 
time to do this set o^ problemis.) • ^ 

538 + 198 = 

539 + 199 



CSMP classes had significantly higher scores oh this test, A0% correct versus 32%. 

Above and Below Zero. In the revised MANS in second and third grades, thefe 
was a short test required students to use negative numbers in the simple cofStgxt 
shown below. 

Score at the start: 5 belevv zero 

then: won 2 ; ^ 

Score at the end: 7 belrfw zero 3 below zero 3 above zero 7 above,:zero 

CSMP students did slightly better in sec brxj grade (average percent correct = 38 
versus 35) but the difference was not significant. CSMP students did, quite a bit 
better" In third grade (mean percent correct = 53 versus 42) and the differences 
were significant in mast 3oint Research Studies. 

Indiviriuqlf y Arim ini^tered Pr oblems, in one of the problems administered in third 
grad e each student was shown a partial calendar with "69 cents" written irder 
each day of the week and told that "Bill aets 69 cents every day this week". ^ 
They were then asked to describe the fastest way, on\a calculator, to figure out 
"how much Bill would earn by the end of the week". 

CSMP students were more likely to suggest a maltipHcation process (88% versus 
53%) and less likely to suggest an addition process. 
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P^iatlonshlps and Number Patterrs, 



eSMP classes had significantly hl^er scores dh the Relationships aid Number 
Patterns category at- ev'ery_grade level except second grade (whefe^ the difference ^ 
approached significance). Sixteen but of 22 tests procfcieed significant differences; 
except at second grade^ almost all te^ts produced significance.. Across all grades ^ 
and test items, 63% of the CSMP responses were^ correct versus 55% for Non-CSMP. 

Figures 27 and 28^ illustrate. the findings.. Figure 27 shows second grade class 
means using the revised MANS in Jbint Research Studies. In these more recent 
studies, CSMP performance Jmprbved to the extent that the dffference was 
significant, as can be seen_frbm the figure.. Figure 28 shows fourth grade class 
means and needs no comment. ' : 

Relationships 
^ and Patterns 




Relationships 
and Patterns 




Fig, 27. Second Grade Class N/6ans " Fig. 28. Fourth Grade Class N^ais: 

Relationships S.Patterhs. Ftelatlonshlps & Patterns 

JolntResearch Stydies Extended Pilot Test 

(X = cpp Classes, • = NDn-C9vp) (x = ON^ Classes, 9 = Non^C^^i 

Of all the categbries, Relatibhships and Number Patterrg^roduced the most ' % 

^ consistent differences acrbss ability levels. Figure 29 sho*s sixth grade student 
me^s when students were grouped into quartiles accordingito Vocabulary scores. 
Notice that the line segments joining the points are virtually parallel. ; 



Relationships 
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Fig. 29. Sixth Grade ^Student rvfe^s, 

Relations and Nurber Patterns 
. . Students grouped by Vbeabulary Score 

(X^= (^^vp Students, • = Non-<SvP) 

' ■ ■ ,05-. . 



So lving Numtier Rules, This test has been used at all grade levels,^ trpugh m 
TTerent formats, the sln^iplest bo understand, picto is shown telow from 

fourth grade. Students were told' that Machine A always did the same thing to 
any rijmber that went into it; the first three rawf gave examples of how the 
particular machine wbFked, 



-3- 




WHAT CAME OOT? 



BUT 




A 




WHAT WENT IN? 



IN 



oirr 




~f 5 



Figure 3D. Ittr^. frdrti l^dur th Grade Test: Solving Nurber F^les 
Left itrhr: exarple (part of explanation), 
' Rl^t iteair test item 

Students first had to figure put the common relaUonshIp tetv^ 

ordered pairs and then lee that kngwiedge to figure out the missing entry outptit. 
The test got progressively more difficult by grade level. In third grade, the 
missing entry was somtetimes an "input" rather than an output. Jn fifth grade, 
more complicated relationships were sometim used*,^ for example^ the output 
number was one less than 10 times the input number. In sixth grade, SDme items 
qsed d©::imal numbers. 

eSMP students always did much Better than Non-CSMP stu^dents, their ^^s^ 
being l4%-25% higher* (even in the non-slgniflcant second grade results), 

CSMP students did better oh all types of Items; on everx_one of the 41 items in 
the various grades, GSMP students had a higher percentage correct. Their 
advantage was a little larger on multiplicative (versus addltlvej rflationships and 
on to what rr.^ht be called "two-stage" relationships. Examples are shown below^ 
in abbreviated format. 



2nci Grade 3r() Grade 4th Grade 5th Grade 6th Grade 



2 - 


1 


. 6 - 


12 


6 - 


3 


36 - 


6 


A - 


2 


. 2 - 


A 


16 - 


13 


100 - 


18 


8 - 




- 


^n 


8 - 


5 


81 - 


9 


16 - 


? 


? - 


8 - 


? - 


9 


? - 


2 



100 
0 
10 
1 



30A 

34 

? 



J 



U sing Number Machines, This test^ also admihlstered In one form or mother in 
alJ grades except second, was pdsitibhed in the test booklet aftet the test 
describes above and used the sahne; concept of number machine. On this test, 
number machines cpuld be hooked'' together as in this sample from the fourth 
grade test. ^ f 



2 




In the upper grades, rric^t problerns involved a missing input- * In sixth grade^ 
some itenns used decimal numbers. 

s 

C_S_MP classes scored signifieantly higher at every grade level, with ai average of 
62% versus 52% correct. They also had a higher percentage correct on every 
itemi at every grade level. " ■ 

CSMP students did especially well,^ relative to Non-CSMP classes, on problems * 
:where combining machines (composing functionsj^ was a better strategy than 
working one step at a time. The last tPjfee items below show exarrples of these 
problems. The first two are more general and straightforward problems. 




Labellih g Number. Lines, Students had to label the err^^ a partially 

labelled number line, as in the example below from third grades 



25 



— r- 



125 



150 



200 



This test was admlriistered In all grades excej3t fifth grade. More frequent use 
of interpol^on and extrapt)lation were required in the upper grades, aid some 
sixth grade Items used decimal numbers. 

eSMP classes classes got better at this with each passing year. Their scores ^ 
were almost identical to Nbn-CSMP students in second grade^ higher but not quite 
significantly so in third grade, and substantially srtd significantly higher in fourth 
and sixth grades (an average of 68% versus 49% correct). They did best, relative 
to Non-eSMP students, oh itenps with large "gaps" to work with, requiring either 
interpolating or extrapolation, as in the examples shown below. 



0 



14 



35 



49 



14 



23 



Which (wnnlp nu mber, fraction, decimal) is larger? In third grade, this tf^t 
concerned wRoIe^namtDers,^ for example 3 x 162: versus 4j( 160. Students 
were given only a few miinutes to do many items SD that computing exact 
answers was unwise (and stibhgly discouraged). CSMP classes did significantly 
better on this test and their advantage was greatest on items with fractions, and 
on sabtractibh itemis such as 

500-201 . versus 500 - 189. 

In fifth and sixth grades fractions were used instead of whole numbers. CSMP 
classes had slighdy higher scores each year (an average of 75% versus 70% 
correct); this difference was significant at sixth grade, but not at fifth. The 
largest difference was on an item with improper fractions: 5/2 versus 5/4. 

In sixth grade there was also a test that used decimal numbers. CSMP classes 
had significantly higher scores than Non-CSMP classes, 82% versus 72% correct. 
The largest difference becurred ah the fbllbwihg items: 

6.1 versus 6.Q1 and 0.9 versUs 0.111. 
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-^^g^i_Sli^ultip Hcativ g Series. In fourth grade^ there Were two scales deailng 
with series of nurribers. The first one is illustrated be) " 



ebdriting by 98 's 



98 



196 



294 



392 



Will 492 be in any of the boxes? 
Will 980 be in any of the boxes? 
Will 590 be in any of th^ boxes? 



CSMP classes had significantly higher scores, though the difference In scores was 
small (average percent correct = 63% versus 66%). 

The other test in fourth grade concerned multiplicative series, as illustrated 
below: , 



50 



200 



400 



800 



■ Y 

The dLfferehce in scores was dramatic; average percent correct = 60% versus 
32%. This test produced the largest CSMP - Moa-CSMP differences out of all the 
tests administered in the Extended Pilot Tests. Figure 31 shows the graphs of 
class means for this test. The X's and dots are widely separated except for three 
low scoring CSMP classes; these classes were all from* the same school aid were 
the only classes, from their district (a large urban district) which participated in 
*his Extended ^Pilot Test. 



/f\ Multiplication Series 




Reading 



Pig. 31. Fourth 6rade Class Means, Multiplication Series 
Extended Pilot Trials 

(X = QSfyiP Classes, • = Mon-CSMP Classes) 

ii8 " 
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Fractions aid p eclm^s Be^wisen Twa Others^ For these two^tests, stadehts had to 
produce a ffactldh decimal) number, as shown by these examples. ^ 

is larger than 1/10 but small^ than 1/3. 

is larger thsn 1.25 but smaller than 2.06. 



Oh the test with fractlonSj there was virtually no difference between eSMP and 
Non-CSMP classes. On the test with decimals CSMP had slgnlficant^^^^ 
scores; mean percent correct = 89% versus 8196. These percentages are high 
because only two out of seven items required the student to extend the numiber 
of declmaT places In the answer, and on these two items, shown below, eSMP 
students did much better than Non-CSMP students: . * 

^ is larger than 0.2 but smialler than 0.3, 

- ; is larger thsn 6.42 but smaller than G.43. 



Sequences. In a second grade test^ students had to determine the milssihg hUmiber 
in a sequence, such a the following: 

^7, 11, 15, ?, I23, 27 

. - _ _ .§ _ - 

In the Extended Pilot Test, OSMP classes had higher scores (48% cdrrect versus 
42%) but the difference was not quite significant. In subsequent Joint Research 
Studies, the diff^ences were larger and rridre likely to be significant. 

IrYd lvidua! AHmtnl$h^red Problems. In a fourth grade problem, students setpretly 
drew a number ouF of a hat (but the interviewer knew that the number was 24) 
and answered a series of questions /about their secret number. The questions dealt 
with^ concepts of order, whole nUhnbers, negative numbers, multiples and divisors. 
The students were also asked whether the question Itself was a good one. (For 
exarrple, after finding out__that the number was less than 100, a c|jestion about 
whether it was less than 200 was not a good question.) 

CSMP classes had significantly higher score^, 82% correct versus 67%. 



r 



118 



:j EJucidatibh of - Ma ltiple ^Ds wers * 

jhe .second and third grade tests in this category differed considerably from the 
Sfapf i'n' grade with rather ^ff^^^^ remits. In .seconrand 

' fof?^!.! I - K '''^T'^' ^^^^ 9ive as many answers as possible but of a potentiaily 
infinite number of correct answers, for example: " ^ 

Sentence,s about 8, 8 = 5 ♦ 3 

8 = I X A 
etc. 

Equations* using only these s/rbois: = ♦ - x 1 2 3 

* • eg. 2 ♦ 2 ♦ 2 = 2 X 3 ,v^' 

etc. ■ , ' ■ * , 

For ea^h or the three tests ti grades 2 and 3, CSMP classes produced about 6% 
more correct responses^ than Non-CSMP classes, a small but non-significant 
difference. Most of thg difference ocqured at the higher ability levels. • 

In fifth .and sixtH grades, this category contained several problems, each of which 

nihr^^^.T^T f ^^"^^^^^ ^"sfy the given constraints. 

Altogethier in the two years, a total of seven different kinds of problems were ' " 
used ^and are (^scribed briefly below;; in all oases students were to givi as many 
possible correct answers as thej could. The first problem is shown as it appeared 
on the student page; the others are shown in abbreviated form 



"trlrt : T«kf out thrtc'bdis. 



Wd to get • tot«l icort. V 
ttvr «n the poSitBle icorii. 5J. 




start at zero, count by X's and reach exactly 24 

pick oat 3 balls, add the numbers, what total' seoras are possible'' 
fusing a container with 6 balls nurhberetJ 1, 1^ 2, 2, 56 and 50)' 

what whole numbers use only the digits 1, 2 and 3? 
(no digR to be u^ed more than ,ohce in "a number) 

what numbers are multiples of 2, and multiples of 3 and smalitr than ^Er?;'!- 

if P ♦ P ♦ Q = 7, what could P and Q stand for? 

' what whole numbers are even nurnbers, Svislble by 5, and < 88? * 

CSMP classes did much better than Non=CSMP "students on these tests; the 
average pereents correct were the same at each level, 65% for CbMP ve.-ar 53% 
for Nj»n-CbMP, . 
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It was also true both years that the greatest. .difference in scores dccyrred at the. 
lowest ability levels as illustrated in Figure 32^ which shows average Elucidation 
liiiores for sixth grade students grouped according to reading score. 




Fig. 32. Sixth Grade Student Stu(*nt Msans, Elucidation 
Students grouped by vocabulary score 
(X = students, i = Nbn.e9vp) 

In the revised version of the MANS, item formats like the ones tfied In flfth_ 
grade were extended down to third and fourth grades- Subsequent Joint Research ^ 
Studies In tfpse grades reajlted In higher scores on these tests for GSMP classes,^ 
significant about half the time. The fluency format was retained in second grade 
■with results similar to those jound In the Extended Pilot Tests, I.e., slightly 
higher scores for CSMP classes, but not slgnifieantiy so. 

In sixth grade there was a test similar to the flue r)ey-l ike tests In the lower _ 
grades^ Starting from zero, and using any of the four operations with numjbers 2, 
3^ 3 an 7, students were to construct sequences of calculations which would 
produce an end result of 12. For example; 

. ^ ' 0 =5 5 ^ =8 8 = ^ ^ = ^2 

CSMP students gave about 5^% more corr^t solutions, ah easily significant dif- 
ference, though it should be noted that this format Is very similar to arrow . 
diagrams (although^ students rarely chose to draw sach diagramis In their tx^oRlets 
for^ this test). 



WcTG prctolems Of the kind found in textbooks and standardized tests (mainly bh 
step,^computationally oriented problems pcsed^jrt sentence form) do hot appear- 
the^ CSMP curriculum and teachers have commuted on their absence. Never- 
theless, the curriculum Is saturated with mathematical problems (albeit In 
different formats), and GSMP students -have usually done is well ^ or better t^ 
Non-CSMP students on the word probl^ sections of standardized tests. 

The Word Prdblems, category of the MANS Tests contained tests which were eor 
structed on the tjasis of the kind of problem being posed. Thus, rather than a 
single long test containing different kinds of Items, there were several short 
tests, each containing, several items of single kind. The computation and readln 
skills- needed to solve the probiems were kept abnormally low. 

Altogether there were a total of tests administered in> grades 2-5. With two 
exceptions, to be discussed later, the results were ranarkably uniform, r^ardles 
0/ type of test. eSMP students always did a iTttle better thafi Non-CSMP ' 
students; typical percentages correct were 55% verjus 5QX. These remits were 
either barely significant or not quite significant. Out of-' the 12 tests, five were 
significant at .01, two were significant at .05, and for the other five tests the 
p-value was between .66 and .14. 

vWbrd Pr^lem scores were fairly well predlcted:by Vocabulary scores. This 
nrieant^Hat relatively small differences in mean scores could still be significant. 
FigtjF^ 33, below, shows fifth grade class m:^ans on the total of two Word Proble 
tests, dealing with two-stage and thfee^stage word, problems. The adjusted mear 
scores favored eSMP by 6.6 versus 6.1, a fairly small difference which was 
nevertheless significant at the .03 level. The gra^h shows that most elates were 
represented fairly close to' the regression, line and there were few outliers. 



Word Problems 




Reading 



Fifth Grade Class N*ans, Vfcrd Problars 
f-xt ended Pi lot Tests 
(X 5 ciiNP CI asses i i ^ Noh-C^J 
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Some -of the tests were adrhlhistered In rhdre than one gradei though at least 

some of "the Jtemi were different from gr^^ Altogether, eight 

different kinds of tests! were tsed and these are listed below with sarrple items. 

One stage word problems. 

Mr. Rich lost $166 from his wallet. 
Afterwards h^ still had $2QQ. i 
How rrjuch did he have bo begltv^wlth? 
(Said aloud b^ tester while second 
graders looked at cartoons.) 

two stage word problems. 

There are 40 apples in our barrel now. 
We will eat 2_apj3le9 every day. 
HOW many apples will be left In eur barrel after 5 days? ( 

Three stage word problems. 

' Joe puts boxes into piles. 
Each box Is 1/2 foot high. 

Each pile is 5 feet high. " _ _ ^ 

How many boxes does he need to make 3 piles? 

r 

Word problems with rounding. 

It takes 4 men Jo lift a piano. 

We have 1 4 men ready to work. 

How many pianos can they lift at -the same time? 

Word problem approximations. 

Martha can jvalk 2 blocks in 5 minutes. __ 
i About how many bloci<s can she walk in 1? minutes? 

5 blocks Id blocks 15 bloefe 18 blocks 

Extraneous data. 

sue has 12 bottles. 
It takes 36 bottles to fill a ease. ' 
It takes 6 bottles to fill a carton. 
How many cartons can Sue fill? 

Fractional word problems. 

1/3 of a dozen eg^ is - eg^. 

Novel word problems. ----- , . ^--,1 

(This sixth grade test contained 12 miscejlanedus problems Includrig decimals, 
fractions, estlrnation, rounding, and 2-variable problems like the one below.) 

Steve has 7 bills. -- - 

Some of them' are $1 bills snd some are $2 bills. 
Altogether he has $10 in bills. 
How many $2 bills does he have? 
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Two exceptlbhs to the general overall pattern of small CSMP advantages were 
alluded at the beginning of tPils section. These exceptions concerned a test used 
in fourth and fifth grade involving decimals. The test consisted of a series of 
questions, all of which began *'X has 6.5 gallons of gas". The item below'' 
happened to appear In both fourth and fifth grades. 

Joe has 6.5 gallons of gas. 

He uses up four gallons. 

How much gas will he have left? 

CSMP students did rnUch better than Noh-CSMP students; an average of 46% 
versus 30% correct In fourth grade and 64% versus 50% in fifth grade- No doubt 
these differences reflect CSMPs earlier Ihtrbductioh to decinnals. 
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Number Representatlons- 



this category cehtalhed a wide variety of tests, with a shift from whble numbers 
and place value in the lower grades to fractions _and declmajs in the t^per 
grades; eategorizatlbn of these tests was rather arbitrary; some of the tests 
described beibv* coald as easily have been placed In a different category. 

__• » 

In second and third grades of the Extended Pilot Tests there was only one test in 
this category and eSMP classes had significantly hisher roores on each. In the 
second grade test, simple numerical facts had to be matched with corresponding 
dot representations as in the example below: 
12 - 3 = 9 



9 m 



5 + 



-dtc. 



5+2=12 



In the tlird grade test, students were given a partlally^overed eompatatlon and 
asked whether the given ^swer could be right, for example, 

129 
+2?? 

There were three tests In fourth grade and examples from them are given below. 
None of them produced significant differences, though eSMP classes were^a lltUe 
better on the first one (aveTiye percent correct = 38% versus 33%), the,dlf- 
ference just missing significance. There were no CSMP - Non-eSMP differences 
on the other two tests. 



EI 



fi i ± -1 
^ *f 1 *♦ 



■ ' ' 



i 2 



i i i f 






* 


-H ^ 




) t * 






IJOOO 



6.109 



Using bnly_the digits 5, 7, 2 and 8 (no digit more than 
what 3-digit number Is_ closest to 6,000? 
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'"..•^^s. revised MANS Jests administered In Joint Research Stadles these two tasks 
were replaced by different tests which were simpler to administer; in second 
grade the test contained two types of Items. One required the skadehts simply to 
.write a three-or foar-dlgit number read aloud by the tester. The other required 
students to write the number .that is 1 (or 10 or 100) greater than (or le^ than)" 
a given number, for example, "What number Is 10 more than 495?". eSMP did 
better (average percent correct = 59 versus 54) but the difference was not 
significant In most districts. 

The revised^ third grade test required students to determine whether one number 
was 1 or^lO or 1 00 or 1000 more than another number. None of the answers 
was exactly correct. Students had several questions to do in a short time and 
were discouraged from calculating the exact answer. An exartiple is given below. 

1 

_ _ 10 



4,265 is 100 ^re than 4,254 
1000 *^ 



CSMP classes had 
difference was 



er scores (average percent correct 
cant in about half the studies. 



= 50 versus 46) and the 



In fifth grade, there were four tests dealing with fractions and one with 
decimals. The fractlbh tests contained -the following tasks: marking fractlbris on 
a ruletj shading fractiohaj parts of geometric figures, selecting equivalent 
fractiqnsj and showing fractions oh a number line. None of these tests produced 
significant differences. The decimal test required students to show metric 
distance/ and compare the size of declmial numbers. eSMP students did much 
better^thai Non-CSMP students oh this test, average percent correct 
= 66% versus 50%. 

In sixth grade, there were two tests^ both of which produced significant 
differences in favor of CSMP. One was an omnibus test of fraction and dectmaJ 
representations, and CSMP's largest advantage was on the decimal portion of that 
te^st. The other test requij^d students to determine which fractions or decimals 
which were equivalent to a ^iyen fraction. This was similar to a test in fifth 
grade where the difference did not quite reach significance; in sixth grade it was 
barely significant (p < .03). ^ 



\ 
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EstlmaU ori 



Tests on estimation produced slfinlflcant differehees in favor of GSMP classes on 
9 of 18 occasions. However, the relative differences were asaally qtilte small; 
average percent correct across all tests and grades = 52% for eSMp classes . ^ 
versus 49% for Non-CSMP classes. Most of this difference was due to the strong 
performances by above average CSMP students. Figure 3^^ fifth grade student 
rrieahs grouped by reading score, shows an extreme example of this result. The 
line segments actually^ cross end at the lowest abilltjr level, tslgga- eSMP students 
have higher scores. This crossing effect did not occur at a^WRher grade le^l 
but the CSMP advantage was almost always smallest at the lowest aBWIty le\/6l. 



^/N^ Estimation 




Fig. 34. Fifth Ga-ade Student Nfeans, Estimation, 

' Students grouped by reading score - - 

(X = CavF* Students, • = Noh-eSvp) 

r-^riM-aHng Intervals. In what was by far the mret cbmmoh test tsed In this ^ 
categoryTstudents ha d to respond to. several corriputatlon items in a short period 
of time (an averagp of less than 15 .seconds per item). For |ach item in the _ 
test there was a fixed set of. intervals and students merely had to Indicate which 
Interval contained the answer. For example: 



11 X 50 = 



10 



58 



100 



500 



ipoc 



Only one arithmetic operation was used on any page, except In second grade^ where ^ 
addition, subtraction aid a couple of mulUplIcatlon items were thoroughly mjxed. _ 
Table 23 summarizes the results for each grade according to type of operation used. 

Table 23 

Mean Percent Correct^ Interval Estimation Tests 
First entry = CSMP, second entry = Non-eSMP 
(♦ = sig. at .05) 



Addition Subtraction Mil tip! Icatlon Division 



Grade: 



2 
3 
4 
5 
6 



Contiined 
34 - 32 



54 - 53 
77 - 73* 
83 - 79 



30-31 



50 
69 
74 

8 



43* 
61* 
67* 
61* 



45 - 40* 
49 - 43* 
51 - 48 



rnLPl multiplication Is the operation which produced 

consistent slgnm^ The other operaU5ns produced nTddest ' > 

iiln^^^.f^'^^^''^^^'^ aDmetlmes slghlfieant and sometimes ndt. fhe^sixth 
grade CSMP advantages cdrne almost entirely from , items with decimal :numtfrs. ,:■ 

^ ^ '^^^^'i^'^^ '^^^'^ items in' fourth' and fifth gfade" are thi- ■ 
to ^h^^^-^K^I^^r^H ^1 ^^Sorlthm to find ths exact answer. It is Interesting 
SjC^it. V '^'''^!''''^^^'^^ Nen-eSMP students if the task wfe 

to^sUmate the answer to these Items, but not as .good If the task was S ' 
calculate the exact answer. 

£''-^fhir^'Ii' S^ rP^ were four bthgr kinds of estimation tests ^used. 

in tmra anctfouTEpFaae, CSMP students were significantly better tharfls&cSMP 
filSg: difference was relatively small) on a test with iffls llk^.lt,^ 

1IX) is about 2^r 5 or 10 times as large as 19? . ^ ' 

«» . 

Vk^^u^ r^^^^ each operation, In which students 

had to^select the best of three wrong answers. CSMP and Non-CSMP scores 
were virtually Identical on all tests. A sample item is shown below. 

3,173 " 

15 X 2,111 = 20,173 * 
31,173 

^f^"^,^ J^^.^J^^^.'^^.f^ea^ EsUmatlon, In which students 

had to esUrnate quantities, volames o* areas from pictorial presentations. There 
was no d fferer.ce in scores, it should be noted that, with respect to technical 
considerations (reliability, correlations, etc.) these fifth grade tests wei^? among 
the worst ever produced by the evaluation staff. . 

w/^'^L^'"^'^^' ^'^^'^ to estimate whether fraction computations, such as 

" 'Qi were^ess^ than, equal to, or greater t«ian one. Several items were 
given with a short time hmit. eSMP scores were slightly higher than Non-eSMP 
scores, but the difference was not quite significant (p < .06). 

jgdlvidually Administered. Problems. Two kinds individually administered problems 
nlFiiid yrade prooucea signincant differences in favor of CSMP students. In one 
kina, students were stiOwn a set of completed caiculptions which "a student at 
another school" had done, (e.g. 6 X 13 = 53). Th^ were then asked to. rapidly 
indicate which answers be right" and which ones were "probably wrond". 

Final y students were asked to go back to each probably-wrong answer and tell 
. why they thought the given answer was wrghg. 

CSMP students made a higher average rfcmber of correct decisions (70% versus 
fnaJ their explanations of yyrong answers were more likely to be acceptable 
(89% versus 77%). The largest^ifferences between CSMP and Non-CSMP students 
occurred for students 'of about^verage ability. 



ERIC 



128 



119 



in the other kind of ihdJvldaally adrhlhistered prdtSlerriSi. students were asked to 
quickly estlrnate the number of dollar bills that .wdUld be needed .to_ purchase 
seven items whose costs were as shown below, "but we don't want to take any 
more (money) then we'll heed": 

$1.22 
1.81 
1.51 

I 1.53 « ^ 

1.33 ^ 
1.33 

1.39 i> 

A hi^er proportion of CSMP students (50% versus 3^%) gave good answers, defined 
as ie; 11 ,or 12, and a lower proportion (12% versus 25%) gave poor arewers, 
i.e., <8 or'->14. ^ 
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Special topic Categories 

tptai Of fifteen tests were administered in the five special topic categories; 
Most were administered In sixth grade; The results are summarized below. In 
Table 24. ' 

f - table 24 

SLrhrhary of Special Topic Category Results 







Ntrrtier 


Adjusted Ivteans 


Significant 


Category 


GS'ade 


of ItaTB 






at .05 


Algebra 


6 


12 


> 7.4 


■ 6.2 


* 




6 


10 


9.3 


8;9 






6 


10 


4.4 


3;8 


* 




6 


14 


9.2 


8;8 




Qeonetry 


4 


8 


4.7 


4.5 






6 


6 


3.0 


3.3 


* (in favor of NDn-C3vP) 


Logic 


6 


18 


13.1 


12.9 






^ 


18 


10.2 


10.4 




Organization 


3 


6 


, 3.3 


3.4 




of data 


5 


10 


* 6.1 


6.1 






6 


10 


5.8 


5.7 




Probabi 1 ity 


4 


19 


6.9 


5.7' 


* 




5 


6 


3.7 


3.5 




6 


12 


9.3 


8.6 






6 


10 : 


5.9 


5.4 


* 



CSMP classes did better In the Algebra and Probability categories, with 
significantly higher scores on three of the four tests In each category. Scores on 
the other seven tests were virtually Identical except for One Gebmietry test 
where Non-CSMP classes had significantly higher scores. . ' 

_ 

Algebra. Typical items from the three Algebra tests which product significant 
differences art shown belowi 

If g = 4 and h = 3, then 5gh =? (students read 2 examples. Including one 

^ ^ showing that 3bc nieans 3 x b x c) 

If q = 5, then 2 x = ? (students read 3 examples explaining exponentiatloh) 

- - ■■) ■ 

Ifl<+2 + R + 1 = 7, then k = ? (students read 3 examples) 





a. (^1 
c. (l 



DO) 
00) - 50 



b; 

d; f 1 



r 



(The tester gave an explanatjph^ through examples, to show that 
sum of a^ a + % ... b^ i.e.^ it is the summation operator.) 




50 

5 ^ is the 
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The fdHowrng examples are 
non-significant difference in 



the fourth Algebra test^ which produced a 
of eSMP. 



T 



do 



9 Umes to 



(where has been shown, by examples, to be a 90* fdtatioh arid 

reverses the number of elements In the top and bbttbrh row.) 



Gebmetry. ^ a fourth grade test. In which students had to divide vai 
geometry figiies Sto^ congruent par^ (e.g^ ah equilateral triangle Into four 
congruent partsji^ there was no significant difference between GSMP and 
Non-CSMP classes. 

In the revised MANS, t^ I^Jt vs^as^ placed In Ofth grade and a new test Wss tsed 
In fourth grade. Students were required to select the one picture (but of several 
pictures) which satisfied certain conditions, as In the example shown below. 





4. In which picture 1$ tach dot closer to x thin to 67 A 6 i F 

NS^ In which picture Is each dot just as close to x is to b? ^ * ^ ^ 

hese problems are^ about finding the locus of a point, in two districts which 
administered the revised fourth grade M/^S there was vlrtuaily no difference In 
scores between^CSMP and Nqn-C^ in the third district, Noh-eSMP 

classes had hl^^er a:qres (average percent correct = 73 versus 63) but the 
difference was not significant. 

On a sixth grade test, students w^ a page showing rthe geb^^^ shapes: 

^Bo trlan^les,^ a square,^ j*ect^^ hexagon, parallelogram and aa "open" 

tnansle aid a rectansle, they' were ^ked to study the Rgures, mart< figures 
which were aj ike ir^ some w&yj^ and e^^ aljke. Nbn-eSMP 

classes produced significantly more accep^aWe categories than eSMP ctesses - 
about 10% nrare^ This differerce was significant at^5 and ^as the only^MANS 
Test at any grade level In which Non-CSMP students had significantly higher 
scores. • ' \ . \ 

One of the individually admWst^ problems In fourth grade produced 

siiinificant difference in^ favor of CSMP students, rstudenfcs were given she&ts of 
graph paper, with different ways of labelling •^he 'Ines and some fines heavier 
than others. An example Is showrj ^n next pa^t 
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CSMP students vvere better able than Non-CSMP students to figure out how many 
little squares were shown, were more likely to use a length-times- width method 
and were more Hkely to, use the guide numbers in the margins versus a one-at-' 
a-time counting process^ They were also better able to do related problerTB of 
figuring out the area when pieces were combined Or when one of the figures had 
a "hole" in it. 

Oh a slightly different problem^ CSMP students were better able to figure. out 
how many squares were on a partly hidden role of paper rnarked off at every" 
second square.^ 

Logic .^^£g> tests in Logic were administered in sixth grade and both produced 
almcst identical scores for CSMP and Non-CSMP classes. In a typical problem 
from the first test, students were told there were six boys, each of whom played 
one of six sports. Students then ^had to use the given clUes to figure out which 
boy played which sporty In the other test, students were to select or construct a 
situation which would make a given statement false. (The given statement 
concerned the placement of^ various geometric shapes 'above or below a line, as 
shown in a picture on the student page.) 

In two individually administered problems in third grade, CSMP students performed 
significantly better than Non-CSMP students. In one, students were shown an 
undifferentiated set of "people pieces"^ (simplified figures that were either tall or 
short, fat or thin, boy or glrl,^ and red or blue). They were then asked to put 
them in piles so that all the pieces in a pile were^rriilar in some way aid so 
that the piles were all different from one other.'^SThey performed this classifica- 
tion in as n-iany different ways as they could. CSMP students were ible to make 
more complex sorts than Non-CSMF' students, the average "best effort"' being 3.B 
dimerBiohs simultaneously (versus 2.2 dimensions for Non-CSMP students). 

_ ;- - . -zi 

In the other individually administered test^ students were asked to figure but the . 
Interviewer's "secret" rule for the jjeople pieces^ by offerihg individual pieces to* 
which the interviewer would respond with a "y^s" or "no" according to whether 
the offered piece fit the secret rule* Exarnples of the secret rule vvere "blue" 
and "fat and tall". CSMP stj^nts needed to offer fewer pieces to figure out the 
rule. In four trials, the average total number of pieces ijeeded w^ 14.8 for 
eSMP stadents versus V9.7 for Non-CSMF^ students. 



OrdahUatlon of Data. The three tests In this catQgbry.j administered \l. d^^^^ 
oFade ievels (grades ' 5 and 6) each prbdaeed alrncst Identical scares for CSMP 
and Nbh-CSMP classes. Each test involved the reading arid Interpreting of data 
from -a table (grades 3 and 6) or graph (grade 5). In fifth grade^ some Interpolar 
tioh was required and in sixth grade some of the items required extrapolation. 

Pr obability . Typical items from the three Probability are described below. CSMi=> 
class^i did significantly better on each of the tests. 

Students had to estimate how many times bat of lOO spahs they would get 
a particular reajlt on a spinner. Spinrjers. were divlded,.IntO crequal* but 
easily calculable regions sjch as the one-:sho\^ below. A range of answers 
was accepted for each question. (Foarth grade) 

1 V 




students had to determine:^ow often (never, less thlTi half thfe Ume, half 
the Ume etc.) a pair of spinners would landJo riumbers whose ajm was at 
least 10.' (Sixth grade) Pairs of spInne^FS-^tvIBea In various ways were , 
used, for example: 




5 t6 




students had to seie5t the best of three given boxes from which to make a 
blind draw. The boxes contained differing numbers of 1^ent, 2-cent and 
50-cent balls. This test was adfTiioIstered In t»th fifth and sixth grades, 
producing a significant difference In sixth grade only. j 
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Discussion 



CSMP students performed best', relative "to ision-CSMP students, on tests ^ tw6 
Is tlTat g Arithmetic, and Relationships and Patterns/and ^^st in 

tsumatlon (that isi they were only a UUle better In Estimation). The 
ealegorlzatlDn scheme used with the STOS Tests is one of several possible wavs" of 
organ zing the testing and reporting of student learning. It h^ turn^ buf to ' 
^ a useful scheme anc^seenns to convey the process oflentatlbn of the tests But 
It may not be the most useful scheme for discussing the strengths of IsM^f*-. 

There are a number of fLndamental processes and concepts at which (2SMP 
students exell and whiijti cut across categories. 

1; inverse operations. All of these problerns share an aspect of havlna to think 
resuir^ °' ^^"^ ^""^"^^ condition which will prodtle I gllen^lnl 

□ - ^50 =■■150/' 

1/2 X = 20 , . 

re^^lred'' ^^^^ f^i^ses, where beginning score Instead of ending score Is 

_ _ V ' 

Word Problemsj such as (paraphrased), starting with $10 and savinq $5 a 
week, how many weeks before One can buy a radio for $30. 

2. Recognizing numerical patterns. Examples are additive sequences, multlplica- 

tlve^serles, partially labelled number lines requiring extrapolation, and 
multiples and divisors In Elucidation prdblemis. 

3. Relations. eSMP students see^^ to understand the concept, of relation 

better,^ lhat Is, the tidependent exls^ of, say, >3 as concept, a thing 
In Itself, that doesn't need some particularization (for example 
2 +_3 = 5) fe give It meaning. ' 

This Lhdefstanding was de'monstrated most clearly In tests on living number 
rules^^and^ using number machines. There Is a sense in which these two tests 
are^bjased towar* eSMP students, but any test dealing with relations would 
probably be biased in that sense. The concept of relations Is such a 
fL/idamental one In mathematics that such criticism is hot worth worrylno 
about. i 

4. Relative sizes of numbers. Examples sre selecting the larger of two whole 
number? Or decimals or fractions. For example, without actually 
calculating^ which is larger: ^ 

506 - 201 or 500 - 199 ? 



Early presentation of concepts. CSMP students are introduced to the 
concepts of multiplication, negative mmbers, fractions, and decimals earlier 
than most students and they are better able to apply this knowledge in a 
variety of situations. v a 
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6. • Uslrig Intermediate answers. Examples are: 



i>38 + 198 
so 539 > 199 



736 
? 



11 X 273 
22 X 273 



3,tX)3 
? 



These are all very Important processes in mathematics and the CS MP curriculum 
cbhtalhs many instances of each of them. They are never formally presented . 
named, just us^ over an_d over In different ways In both teacher presentations 
^hd student materials. Together they make for what qne_ might call "street 
number sense", and CSMP students seem to have lt. What Is surprising I3 that 
these processes have a heavy compytatjon component,^ thus ma^^^ 
advantage on them particularly noteworthy since CSMP students are not par Ucu- 
larly strong on straightforward cdmputatign._ This may explain why the CSM^^ 
advantage pn Estimation, very much a street sense attrlbiAe^ Is rather mi^^^ 
although CSMP does emphasize some aspects of estimation, th^t skill Js so 
computationally dependent (or possibly part of. ^ very deep-seated quantitative 
trait) that large gains should not be expected. 

In the special topics categories^, the C^^ In Algebra, 

atei' concepts of variables and transformations, is not surprising since these 
concepts arise In several ways jn CSMP. Similarly, CSMP students should do 
better in Probability and they do. The two sixth grade tests in togie produced 
no CSMP - Non-iCSMP dIffererceSj meaning that CSMPs informal logical thinking,' 
as in the string ^ame for example, do not transfer to the more formal paper and 
pencil MANS items. ; 

In Geometry, CSMP students did no better, and bh one test, significantly less 
well than Non-CSMP students. The three MANS geometry tests were very 
general kinds of problems dealing with locus, cbhgruehcy,^ _and creatlhg geometric 
categories, none of which were particularly stressed by CSMP. No doubt a test 
more oriented to the specifics of the CSMP curriculum in geoiiietry would have 
produced rather different results. * - 

The same could be said for tests briented to other specific CSMP ccsitent ajch as 
negative numbers, modular arithmetic, binary numbfers and other number theoretic 
work. Such tests would have been against the spirit of thV MANS tests^ which _ 
avoided terminology and cqhteht specific to CSMP. _ However, the absence of such 
tests, under whatever rubric, was a mistake. It Jeayes^y CS^P revl^^ the 
position of sus pecting there are rr»ariy specific pieces of mathematlcaj content 
that CSMP lEudents know better than Non-CSMP students, but J^t knowing for 
sure. In this sense, yie evaluation was conservative and underestimated' CSMP 
student learning. - , 
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VI. CDMPUTATleN AND ST ANDARblZED- TEST RESULTS 



Com putation Results 

^^'^^'^^^^ f:^^ been collected on 'eSMP stud^ts' con 

Skills. Data will , be presented from three sources: standardized tests adm' 
as part of the Extended Pljot Tes^s, specially cd^^^^^^ computation te 
mcorporated Into the revl^d MANS for .administration in subsequen Join 
Research Studies, and district-initiated -standardized test eomparSns. 

^^-!^g£^i^g.Hg£^Pg^gMgg^ fforh Ext e nded leilfltutests. Table 

rnr^M^r^^^ Lt^"^^!^';^^'^^ otherwise indicated, the scores were fr, 
computation subtest of the standardized test. In second and third grade 
studies wfire conducted in each district since the, MANS-Tests did not inc 
corrputatlon section. Thus each comparison shown far second and third a 
represents one district. In fourth and fifth .grades, district were combim 
analysis since the MANS Tests contained a standardized -computation test 
cas|s, an Analysis of Cpvarlance on class means was used, with class me"? 
on Reading or Vocabulary as covarlate. >^ c 



table 25 

Summary of Standardized Conputat Ion Score S 
from Excerided PI16E Testa 



Gr ade 
2 

3 



Test 




Number 


of Claasea 


^^lusted Heans 


Sigif _ 


In 






CSHP 


Non-CSMP 


CSMP 


Noh-CSHP 


at .05 


Favor 


CTBS 




15 


13 


20.6 


19.3 




CSMP 


CTBS 




6 


6 


20.5 


ie'.6 


N 


CSMP 


iETS Coop 


Pr ii' 


6 


6 


36.2 




N 


Nbn-C 


S t anford 


Ach 


6 


6 


4 7.62 


52.02 


N 


Non~C 


CTBS 




12 


12 


/^6.1 


35,4 


N 


CSMP 






15 


13 


'35.8 : 


36.8 


N 


. NonHC 


ETS Coop 


Prtn ^ 


6 


12 


42.3 


4 1.8 


N 


CSMP 


SAT 




30 


21 


23.3 


25:3 




Nbn-Ci 


CTBS 




31 


25 


34.9 


34.3 


N 


CSMP 



Total Math; This t^st does not have a separate cdmputatidn section, 
k>etcentile Ranks 



There a batal of nine conparlspns given above, and three, different tests w 
used. Five of the comparisons favored CSMP and four favored Non-CSMP. 
one of the nine produced a significant differpnee: in fourth grade^ Non-C' 
classes had significantly higher scores than eSMP classes 'On the Computatl 
Test of the Stanford Achievement Test; 
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Figure 35 shows, the graphs of class m for fbcirth grade classes from the 
Extended Piiot test. _It can be seen that the Noh-eSMP advantage is dde to the 
relatively poor performance of CSMP.high 



^ Stan ftch Test 
Computation 



Reading 



Fig. 35. Fourth Grade Class Nfeans, Ocrrputation 
Extended Pilot Test 
(X = class, 9 = \^Vi-Q3^ class) 

Figure 36^ below, shows the graphs of class means fqr fi^fth jra^ classes from 
the Extended Pilot Test. There is no dlis:ernable pattern between CSMP and 
Non-CSMP scores; in fact, computation score Is not very ^ well predicted by 
vocabulary score, 

/t^ CTBS 

Computation 




Reading 



Fig. 36. Fifth Grade Class N^ans, Corputatlon 
■ Extended P] iot tpsf 
- = nla.. « = isbn-C^ class) 
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joymty costs. The Items were restricted to whole rumb^ and ^PlprHnn v^ac 

— - _ ^ / 

J^ ^^J^"^^^"^ compotatlen results from the revised MANS Excent frir 

Table 26 

- Summary of Revised MANS C<Mpatation- Scores 



Number of Classes Adjusted Means Sigif 



In 



Grade CSMP Non-CSMP CSMP Non-CS^fi. at .05 Favor of 



2 



'9 10 10.0 lb. 5 

* 5 9.1 10.2 



15.2 13.4 Y > CatP 

N CSKP 



Nbh-CSMP 
N CSMP 



21 26 12.6 11.8 

.f f 12.1 12.6 N Non=CSMP 

' * 11.3 10.1 N CSMP 



2 2 15.2 14.0 

2 I 12.1 9.3 



CSRP 

— CSMP 

^ 2 10-0 11.4 - NbnKTSMP 

20 ^6 • 17.2 16.7 N CSMP 

* 15.7 18.0 N NonKTSMP 

* 16.1 15.3 ^ CSMP 

20.6 19.6 N CSMP 

13 17.2 16.8 N CSMP 

2 2 17.5 15,0 _• ' 



23 23 21.3 21.5 



N Noh-CSMP 



^ ? 21.0 19.9 N GS!P 

5 7 19.3 19,5 



27I 36l 



N Noh-CSMP 
18.9 19.2 N NbnKTSMP 



1 Sixth grade EPT; classes from several districts combined into a single 
study - ^ 



There are a total of 19 comparisons given above. Twelve of the comoar- 

i'°^"minSW''di?SrK^''''" '^^^^ °"^>' of the nlnetSn produced 

^ significant difference, a second grade comparison favoring eSMP. 
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Figure 37 shows cl^s means ftn ebrripatatidh for all second grade classes 
participating In Joint Research Studies, 
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Fig. 3X. Second Grade Class N^ans, ecrrpatation 

Joint Research Studies 

(X = class, • = Nbn-^^ class) 



Figure 38 shows third grade computation rrfeans from Joint Resear* Studies. 
Although there Is a slight CSMP advantage overall, It is hard to discern from the 
graph. Computation scores are poorly predicted bj^ vocabulary scores; for lower 
ability classes especially^ there Is great variation in scores. 
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Fig. 38. Third Grade Class N^ans, Gcrrputation 
Joint Research Studies 
(X = C9vf> class, m = Non-CS^P class) 
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Congutat^ Evaluations, In a number of sites, 

district personr.eT_conducted a formal evaJuatlon of CSmP by cbmparino the oer^ 
-formance of CSMP and Non-eSMP classes (or students) on their district, 
administered standardized achievement test. No doubt many more evaluations 
were carried out than could be located for this report, and certainly many 
jH^Q'^^aJ evaluatlQns were completed and never officially reported. 

Table 27 ^summarizes the data from those districts which reported separated 
computation ^ scores.^ Diiferent m aggregating and analyzing the data 

were used at each site,^and significance tests were hot generally reported. 



Table 27 
Summary of Computation Scores 
frcin Locally Conducted Cbraparison Studies 



District Grade 



19 



17 

17 
17 
8 

8 

12 
12 



Test 
CATH::6mp 

CATH^bmp 

CTBSH::bmp 

CTBSHirbmp 

CTBS-Cbrap 

ITBS-Cr Ref 
SRA-er Ref 

ITBS-Cr Ref 
SRA-er Ref 

ITBS-Comp 
iras-€orap 



Compar ison 



Mean Score 
CSMP No h -CSMP 



17 CSMP Classes versus same teachers' ^11 
previous Non-CSMP classes 

100 CSMP and Non-caiP students 
sampled from 6 schools ^ 

6 CSMP classes versus same teacher^ 
Pl^evious CSMP classes 

Same as above 

Same as above 



16^J7 CSMP and Non-CSMP students 
sampled from 2 schools 

20-24 eSMP & Non-CSMP students 
sampled from 2 schools 

5 year longitudinal study of 

70 eSMP versus 90 Non-CSMP students 

same as above 



60 

307 

376 

394 

69 
81 

63 
69 

6.4 
7.8 



280^ 

5l2 

312^ 



•^^^•d »core across classes; 

_ *n approximately eqoal dec line bccur red in Heading. 
3 ^*^"^^^^/^P'^^*^^?"r >?«£i_ip_»e«n student scale scores; 
. ^Justed^an scaled score across classes. 1 

Average mean percent correct across Items. J 

Mean grade equivalent scbrei across students. 

Altogether^ five d]s_t_ricts conducted hihe studies^ two in each of grades 2-4 and 
one in ea:h of grades >7. Of these nine, three gave resaJfes favorable to CSMP 
and six favorable to ^n-CSMP. Only three studies prodaeed large differences- 
District 4 (in favor of CSMP)^ and District 8, grade 5 and District 12, grade 6 (in 
favor of Non-CSMP). Thrise studies using Total Math score (reported in the next 
section), in which computation was one component, produced virtually no 
differences. - 
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Fraction arid Decim al C brh putatidh* . In each of the grades 5-6 Extended Pilot 
TesEsTThe^MANTTes^ of 6-10 items requiring stradght- 

forward computation with, fractions. CSMP classes had hl^er s:ores at each 
grade level; much higher by. about 23% in fourth and fifth grades/ aid slightly 
higher (though hot quite a significant difference) In sixth grade, 

CSMP students were much better at taking fractior^I parts of whole num^ 
Cone-nth of a number) and ahything Involving commonly used fracU^ 
1/2, 1/3, 1/4, and .1/1. On the dther hand CSMP students were not as good at 
working with fractions of uhliRe denominators, i.e., the algorithmic part of 
fractional cbmputatlbnal §<ill5. These results are also consistent with CSMPs 
curricular emphpsis. 

In the sixth grade Extended Pilot Test, the MANS Tests includedl^a sho^^ of 
straightforward decimal cpmputations on which CSMP classes had signlflcantiy 
higher scores than Ndn^CSMP classes. 

Discussibn. Among these three kinds of comparl^ns,^ a tota^ of 37 , 
conducted. A total of 32 districts participated^ either In separate studies (20) or ' 
as part of larger studies (12). Twenty reajlts favored CSts^P and §eventeen 
favored Non-CSMP. Only 6 of the 37 studies produced slgnlfjcant dr "large" 
differences/ three in favor of CSMP and three In favor of Non-feSMP. Thus (Xie 
can safely say that, overall, CSMP and Non-CSMP classes performed about equally 
on tests of computational skills. . 

However^ if one analyzes the results sjeparately by primiary grades (2,3) and ihter- 
medlate grades (4-6), the results are somewhat different. In the primary gractes, 
17 of the 24 studies favored CSMP, Including ail of. the studies producihg large 
differences in favor of CSMP. In the intermediate grades, nine of _the tweWe 
results favored Non-CSMP^ Including all three of the studies producing large _ 
differences in favor of Non-CSMP. It is stiir)true that most studies, regardless 
of grade leve],^ produce little dr no CSMP-Nort-CSMP difference^ but there is 
some indication of be tter CSMP performance in the lower grades and poorer 
CSMP performance inTFie upper grades. 

In addition, based on analysis ^f Extended Pilot Test data, there were c^^ 
computation skills which CSMP students were better at_thah Nbh-CSMP students 
and there are other skills in which, they were worse. Furthermore^ the pattern of 
these differences was consistent with the differences in curricular emphasis. 

in second and third grades, CSMP . students were a little better ih_ addition and 
multiplication, -and a little worse in subtraction, especially when it required 
borrowing. 

In fourth grade sharper differences became apparent. There were, no differences 
between the two groups oh additlbn and subtracticr» questions, norl c»n jxie-dlgU 
multiplication and division questions (i.e.^ basic facts). But CSMP^udents did 
significantly worse than Non-CSMP students cr[ multiplication and^ d 
questions containing mclltl-diglt numibers and requiring an algorithm. 

This difference persisted in fifth grade^ though It was a smaller difference and 
counter balanced by better CSMP performance on items invplving column additlbri 

and decimals. ^ ^ . 

♦ 

By sixth grade the difference tetweeh the ^ groups' performance was ^v^ 

srriall^ never more thai 5 percentage pcDints on any Item. But CSMP students 

were still better In addition, worse , in division, and once again vs^arse in ^ 
subtraction. • 

132 i4i 



'f^^ ■consistent with the differences ^tWeen the esMP curriculum 

what s in most standa^^^^ tejct ..egiQ(<s. The maltl-diglt aig5dthms 

for rntiltiplieatlon and division are Introduced latgir In GSMP,- ate toE tal^en to the 
"tinal" efficient form that most students finally learn, and are practiced less 

often. i—'"*^.--,- , : . 

Moat te^hei^ reeognlzed^$ and later emphasis on these algorlthmlG 
skills and sapplemented the prograrn accordlraly to ren^iedy the problem., the 
I^OTt of supplementation infected class peiTorrriahce-on^ commutation tests. In 
fifth 5rade, for example, hlgFi^gpjementatioh was one of ajgroap of facS'rs 
associated with hi^^r scores in computationally oriented tests ahS With lower 
scores oh content emphSized by CSMP. The other factors were?^ 



more teacher experience, 
more homiework assigned, 
less CSMP training, and 
less playing miath games. 



This indicates that ihcre^ing ajppiemeritation aid homework tended to produce 
more traditional student achievement, i.e., higher in computation but lower in 
other content. 

Given the different patterns of achievement 'in computatiqRars^^ the results df 
any- comparisons between CSMP and Non-CSMP classes are likely to depend 
somewhat on the c^om^s^^ used; CSMP classes are at a disadvan- 

tage on tests which-^phasize algorithmic skills and de-emiphaslze other kinds of 
computational skills. » • ■ ; 

The data with "begard to differential computational skills at different ability levels 
were inconsistent. Through fifth grade the results vis-a-vis CSMP versus 
Non-CSMP-were similar regardless of student ability level. If anything^ lower 
ability CSMP students (thbse scoring in the lowest quartile on the covariate 
reading test) di^ better in this regard than did CSMP students at the hilgher 
abili^ty levels. At fourth grade for example, scores at the Iow\st ability levels 
were the _^me, but at the highest ability level they favored N*^CSMP. This 
result is shown in Figure 39, next page. * 

At sixth grade, however, the resjlts were reversedj, the lowest *ility CSMP 
students scored lower than corresponding Non-CSMP students, but there was no 
difference at any of the other ability levels. This result, the only instance of 
this phenomenon, is shown in Figure 40. 
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^ Fig. 39. Fourth, Grade OTrputation Msanst ^ Fig. ^0. Sixth Grade Ccrrputatlbh Miais^ '■ 

' Students grQi43ed by Reading score ' students grouped by Reading score 

(X = CS^ students, ■ = Nbn-<:3vp) (x = C9vp students ^ • = Nbn^CSM') 
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other Stahdardl?ed Test Remits 



Exteoiecl Pilot Tests^ In second ^d third grades of the Extended Pilot Tests. 
• standardized tests wi^re administered by Individual participating districts. The 
computation pdrtidh t^f these tests were reported In the previous secUbh. Table 
28 summarizes the resqlts from the other mathematics tests In these batteries. 



/ Table 2^ 

Summary of Standardized Math Scores (Other than computatibrt) 
from Extended Pilot Tests 

Grade Ttest 



2 CTBS, Cone & Ak> 
CTBS, Cone & App 
Stan -Ach Test, C t A 
Coop Prim Test^ 

5 CTBS, Cbhc & Aro 
Cocp Prim Test' 

, \ : ; 

_ Total Math Score since this test does not have separately scored tests. 
^ Percentile Ranks '•' 

Four of the six comparisons favored CSMP, tHough the only si ghlf leant dlffefenee 
was a third: gtade comparison which favored Non-CSMP classes. It should be 
noted that -this significant , result was derived from scores on the CTBS, the - 
regularly administered standardized test for Non-CSMP classes but unfamiliar to 
the CSryiP classes. " ^ 



J 



Number 


of Classes 


y s t ed Me ahs 


Sigif _ 


In 


eaip 


Non-CSMP , 


feSMP 


Nbh-ca4P 


at .05 


Favor of 


15 . 


13 


18. 3| 


18.2 


N 


CSMP 


6 


6 


18. li 


17.5 


N 


CSMP 


6 


6 


43.5 


47.72 


N 


Nbn-eSMP 


6 


;\6 / 


36.2 


35.7 


N 


CSMP 


15 


13 


31.2 


33.8 


y 


rton-CSMP- 


6 


12 


42.3 


41.8 


N 


CSMP 
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Locally Initiated Studies; Several districJts Wtiated their own cbmjDarisbo stadles 
Detween CSMP^and Non-CSMP classes- Songe q^f these are^ported i^^ the 
previous section^^ Those dealing with'^andardized rriathe- 

matlcs tests jother than computation are reported in Table 29, 

Table 29 

Suwaty of Locally Initiated Standardised 
^ ^ teit Scores', Other than Coiiputatton ^. 

Mean Score 

blitclct Grade Teat Coaparlaon CSMP Non-CSMP 





2 


CAT-Conc 4 App 


17 CSMP classes versus sane teachers' 


323 


332^ 








Dr^vlouK NoH'OSMP cXAHceH 






4 


2 


CAT-Total Mith 


Id CSMP versus tO Non-CSMP classes 


49 


5l2 


4 


3 


cKr--conc i App 


100 CSMP and Non-CSMP students 
sanplcd tzom 6 schools 


48 


393 


^7 


2 


CTBS-Conc & App 


6 CSMP classes.yersup saMe teachers* 

previous Non-CSMP classes. 


250 


240^ 


17 


3 


CTBS-Conc 
CTBS-App ^ 


Sane as above 


383 
351 


366^ 
357 


17 


4 


CTBS-Conc 
CTBS-App 


Sasie as above 


416 
386 


366^ 
363 


2 


3 


CAT-TO tai Math 


14 CSMP versus 13 Nbri-CSMP classes 


389 


385* 


8 


4 


ItBS-Cbhc 
ITBS-Prob 


16,17 CSMP and Non-CSMP students 
sampied from 2 schools 


76 
76 


62 






SRA-Coric 
SRA-Prob 


spne as above 


84 

88 


83* 
96 


8 


5 


ITBS-Conc 
ITBS-Prb& 


20-24 CSMP & Non-CSMP students 
sanpled froa 2 schools 


78 
80 


74« 
79 






SRA-Conc 
SRA-Prob ; 


s«De as above 


83 
80 


786 
76 


12 


6 


1 TBS -Cone 

ITBS-Problems 


5 year Ibngitudlhsl itiidy of 

70 CSMP versus 90 Non-CSMP students 


7,8 

7.5 


7,77 
7,4 


12 


7 


ITBp^rbhc 
ITBS-Prqb 


sate as above 


9.2 
8,7 


8.9^ 
9,5 


16 


6 


CAT-Tbtal Math 


2 CSMP versus 3 Non-CSMP classes 


57,4 


57. 4^ 



^ Mean scaled score across classes; 

ah approximately equal decline occurred in Reading.* • j 

2 Adju8ted_iean raw "core scr cms classes, * 

3 Gain, fron previous year, in aean student scale scores. 

Ad lasted iwah icaled score acrosi classes, ^ 
^ He^n scaled score across classes . 
^ Average mean percent correct across items, 

^ --- - - - ■ : 

/ Mean grade equivalent Korea across^ students^ 

. ^ Mean raw score across students; mean IQ scores ■ 110,0, HO, 5 % 

mean Reading scores " 56,3, 53,8 

Out Of twelve comparisons (defining a cpniparjsyi as one grade level at one 

district)^ eight favored CSMP and 'three favored rslon-CSMP^ thoughfthe d^^^ 
xJn rtibst comparisons was quite small and in only one compaUso^^ 
'grade 4^ in favor of CSMP) was there a large difference. -Fur therxnore, there 

were no graoe level distinctions, nor were there much different findings with 

regard to Goncepts versus^Problems (or Applications). 



i . ■ 

^ ■ .. 

Sqrnnnary 

There have been less than 55 studies, Ihvolving 32 school districts, dorrparing 
the performance of CSMP and Non-esMP students on standardized tests. The 
results could hardly be more even: 32 stud[es favored CSMP and 23 favored 
r^?N^"o ^?. Large ^differences were found in only eight studies, four in favor of 
S^foh^f h""' /fvor^.Non-eSMP. For th most part, findings were similar 
p^h ^ o, subdivisions: computation, concepts and apfSlications, and at 

each level of student or class ability. . , s 

In sfate of these findings, mcst GSMP teachers consider the program to be deficient 
providing sufficient practice in computational skills, particularly rapid recall 
or basic facts (lower grades) , and proficiency with • multi-digit algorithms (upper 
f > '.u^.''^^^'^''^^^^^ does exist with CSMP students, does hot 

affect their performance en standardized tests through third grade. 

However, proficien^^ algorithms is lower for CSMP students and 

does effect standar;3ized test performance in grides 4-6. CSMP students do not 
do as well on Items requiring multi-digit algorithms but this is sometimes 
balanced by better performance on other kinds of computation -Items such as 
those using fractions and decimals. 

Most tethers do supplement CSMP with computation practice and in this/^av 
may^remediate^e perceived deficiency. There is some evidence that increased 
supplementation improves computation scores. For' miny teachers this supplemen- 
tation^ IS done a few minutes^each day, or sent home as homework, and is 
therefore fairly unobtrusive. - . ' . 

•Just as the differences in computation, an area in which CSMP students mlqht be 
expected^ to^do^poorly, were small and easily remediable, so too the differences 
on the standardized problem solving tests, where CSMP students might be 
ppected to do better, were also small. But "problem solving" on standardized 
tests usually means solving one-step word problems with significant cWutation 
and readina requirements, so the results are;- unsurprising. On the MANS word 
problem te^ts, however, where computation and reading requirements were kept 
low, CSMP students had a small but^Consistent and significant advantage. 



in 



- — - < 



On the basis of standardized testing alone, CSMP doesn't seem to make much 
difference one way or the other. If that is the single criterion for making a 
curnculum decision, then CSMP must be rejected because of its cost and teacher 
training requirement. Of course in the ease of CSMP there is a great deal of 
other evidence which demonstrates rather persuavely that teachers like the 




did 

.„ ^ ^fci ,rs — ■ - snd evaluation that was 

done on CSMP, and were scuttled because they didn't get the necessary gains or: 
standardized tests; ^ 
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VIL OTHER RNDINGS 
Erilering CSMP 



Rapid Impiernentatloh Model 



In two districts where CSMP was implemented In a single' sclidb^^ at _ grades K-5 at 
the same timej the MANS tesh were administered to all second, third and;, fourth 
graders^on three occasions: thj^ year before start*up^ at the end of the first. _ 
impjementation year^ and at >the; end of the second implementation year. (Fifth ^ 
grade tests were not available theiyear before start ujD.) One school was in 
District 17,^,a large urban dlstrict^f. and had six classes per. level. The other 

school was in a relatively affluent neighborhood of District 23, a suburban dis- 
trict, with three c lasses « per grade. 

The results were similar in both districts. In secdnd^rade, there was a 
gain In adjusted M'ANS scores_afte_r one year of CSMP and__ah additional 
gain after the second year. This finding is illustrated In Figure 41, whicfi.shbws 
these districtsV scores: in Year 0 (circled dots). Year 1 (squares) and Year 2 
(circled x's). These data have been superimposed oh the graph of district hneahs 
from^ the Extended Pilot Test (which are representecl by regular x's and 

^ Total MANS 




Reading 



Pig. ^1 



^strict 17 and Diyfetrict 23 Second Grade Means ^^^^ 
<^ - year preceding CSMP, « 1 year of eSMP,^) « 2 years CSMP 
(X, • « CSMP) Non-CSMP district means from Extended Pilot Tests) 



In third and fourth grades^ sizeable gains were made after each_pf the first and 
secona years tnough again miDst-pf the eventual gain occurred after one year's 
experience with CSMP. Table" ^0 summarizes the adjusted rrieans. 

V Table 30 

ft d ju sted M e a ns, Grades 2-4 
Rapid Implementation Model 







Year 0 


Year 1 


Year 2 


Second Grade: 


:,District 17 


38.5 


. {42.5 


44.^ 




District 23 


57. 1 


^ 65.9 


6€;4 


Third Grade: 


District 17 


45.5 


49.4 


53.3 




District 23 


86. 1 


95.5 


NA 


FbUrth Grade 


District 17^ 


48.8 


60.9 


64.9 




District 23^ 


123.4 


141.7 


150.4^ 


^ The t' ?:t use 


d in fourth grade 


di f fered 


f r orr. district to d i 
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Tne findings tndi&ete that jt is possible for schools to begin t^ing GSMP right 
away In grades_ 2-4, rather than havlrig to start at K^l and advance one grade 
level each year^ which is the hb rrnal [mpiernehtatibri strategyi When suceessftil 
irn^lernentaUqns .qr this kind hayje taken place, they have been overseen by a 
strcxig coordinator vvith authority In Districts 17 anxJ 23, it was 

probably a strong teaching staff and able students, District 17, and training : 
personnel with year-long^ full Ume poslti^ in the school, District 23; that 
allowed the model to run successfully* 

. ~ . _ ■ . 

Entering Students " ; » 



In the usual method of analysis of Extended Pilot Test data,: students who entered 

class during the course of the j^ear - both CSM^ - were excluded 

from the analysis. In fifth- grade, a separate_ analysis ^w 

students. A separate analysis was also done for studente who transfe^^^ 

class at the beginning of the school year ("new'^ students); 

CSMP experleiiCe in K-4, but then joined an experienced CSMP class in the fali 
of fifth grade. ' ' 



There were 55 and 24 "nev*" CSMP and Non-CSMP students respectively and 31 
and 25 '^late" ''students (an average of exactly_one late student per class). Me^ 
scores on the c$/arjate Vocabulary test and jri the M 

for each groujj,. MANS performs plotted against Reading for eachyOf these 

groups on the graph (next page). •This data has been saperimposed on the original 
graph showing performance of all other CSMl^ and Non-eSNtf^_ students iwhen 
grouped into cpjartiles by reading s:ore (shown earjier). elrcied entries) are for 
new students and boxed entries are for late students. 



Itotal MftNS 




Reading 



Fig. 42. 



-New" and "Late" fifth grade students' MANS score 
superimposed oh graph of regular s^tydents* scores 
(Circled entries * New Students: «X) « CSMP, 
(Boxied entries - Late Students: XJ • CSMP, t*j 



Non-CSMP) 



New students, both eSMP and Non-eSMP, scored slightly lower on the MANS 
scores than students generally, I.e., the circled entries were siighfely below the 
correspq^ding line segments bate students, however, scored quite ajttit lower 
than students generally, i.e., the boxed entries are well below the line segments, 
and this finding also applies bo both eSMP and Notft-eSMP students. Interest- 
ingly, the CSMP advantage in the general population is preserved in eacft'of these 
special grckjps* - > - • 
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In comparison to _other CSMP studehts, new eSMP stadehts haa lower MANS 
. scores^ by.;about 10%^ ori Items dealing with fractions arid probability. Late 
students haql lower scores in almost all areas, but especially In It e^ms with 
rneritgd_ arithmetic and the productibh of riiultlple answers where their scores were 
about 20% ioweri 

A situation half way between whole classes starting the program aid individual 
st ri rtents joining an intact C^SMP class occurred in District 16. In one ghddl, two 
second grade classes studied CSMF^ and the other two classes did rpt- The 
following year all these students studied CSMP asHhird graders.. Classes, were 
thoroughly mixed so that afcout half of each class 'had studied CSMP in first ^d 
second grade while the other half had no previous CSMP experience. 

J _ ._. 

At the end of third §ra.de the MANS^Tests were administered to all students. 
Scores were adjusted for differences on the previous year's Califdrnla Achieve- 
ment Test. These adjusted means are shown in Table 31^ together \A^ith adjusted 
i^jeans from classes of roughly comparable ability who had been tested previously 
during the Extended Pilot Test. 

Table 31 

COTparisbri of New and Experienced 
Thir'a Grade CSMP Students in District 16 



Adjusted Total MANS 
CSMP Nbn-CSMP 



District 16 ; 96,0 92,9 (CSMP only in third grade) 

Other comparable classes 93.1 05.6 

daring Extended Pilot Tests 

CSMP stadents in the Extended Pilot Test outscorei Non-CSfylP students by about 
seven and on e-haif it;ems^ In District 16, experienced. CSMP students outxored 
inexperienced CSMP fludents b about three items. One can Infer fronn this data 
that, under these cifcurnstances, third grade CSMP alone produces about half as^ 
large an incrernental "M effect as the grades 1-3 portion of, the program does. 
This finding is in agreement with findings for Districts 17 and 23 who feed the 
Rapid Implementation Model.. 
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es^^- Graduates 



Leavdng- CSMg 



Not ertD ugh time has elapsed to gather much data on CSMP "graduates." 
However, in three disU"icb (bls^^^^ 2j 12 and 18)^ seventh grade mather 
teachers were asked mid-wa;^ through the school year to rate each of the 
studj^pts using a 4-iten;., 5-point rating scale. Classes were always mixed 
conEarning sDfne ex-CS:MP_ students and somie ex-Mon-;CSMP students- In i 
district there were between 36 and ; 48 ^x-CSMP students who had attends 
elementary school^ and between 74 and 210 ex-Non-CSMP students who h; 
attended 2-4 elementary schools- 



Teachers were asked to rate students on each of four characteristics: 

Participation in class: high quality and frequent participatldn, llste 
attends well^ volunteers responses. 



, ' Motivation: strong -interest^ works independently, interested In "wh 
new ideas. 

Creativity and problem scjlvihg: reasoning and- logic skills, tries he 
methods or several rrristHcjds to solve a problem. 

Practical applications: knows conventional terms and synibdls, can 
and interpret, translates new problenns into familiar fdrrris* 

. ■ 

Averagi ratings at each district were calculated for each item, and a tot 
was calculated from the sum of the four items* Total scchi^s in the threi 
districts^ for CSMP and Non^CSMP respectively, were: 

District 2: adjusted means: . 12.8 versus 12.8 

District 12: adjusted me^s: 12.8 versus 11.3 (p .< .20) 

District 18: unadjusted means: 12.9 versus 10.8 (p < J35) 



There were_ virtually, _nb differences arriong the four rating items, in DJst 
CSMP and Non-CSMP scores were virtually Identical qn each item^ Disi 
each item produced a slight difference in favor bf CSMP; and in District 
was about a half-point difference in favor of CSMP on each it^m. 

_ - ' ' ■ ' ■■ * '"^''f ._ _ ■■ _ _ 

in District 1 12, rrrath grades were compared for seventh grade ^x-fC3SMP an 
ex-Non-CSMP students^ using Analysis of CDvariance^ with Verbal section 
Cognitive Abilities Test as a covariate._ Ttie adjusted mean grades using ( 
B = 4, etc.) were always in favor pf CSMP and are shown beipw for the 
second aid third quarters respectively. 

3.9 versus 3.6 

3,8 versus 3.5 :\ 

3.7 versus 3,5 \ ; ^ ^^"^!'v'v:-- r . .. . ■ ; 

. _ ^ _ _ .. , - J..' . _ .., . 

These differences were significant at .05, .02 and .10 respectively on the 
- of Covariance. 
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rS^^^AwlP T - \^ ""^'^ th|n divided' Ibtb equal sized groups according to 
5°^ . i^^ Ability Test . scores,.. The . mean GAT scores f5r the four groLbs wS 
aboot 90 185 115 and 125, lllustratlhg the f^ct that this dlftrk:f las^pulated 

tUSfr^Hnn '^^'^^ ^^^^ ^^^h grade a^Zlan 

teacher rating were also calculated. Flgare 43 shows the resulting meais. 



Rating by Teacher 




Cognitive Ability 
Verbal Test 

> 



Mathematics Grade 




Cbghitive Ability 
Verbal Test 



Fig. 43. District 12 Seventh Q-ade Student Msans 

v^^ieh grouped by (agnitive Abl lliy Verbal Score 
(X = Ex-C3^ Students, • = Ex-Nbn-C»wP students^ 

W i^^^' "m relatively clear advantage for CSMP students In math grades 

and the small advantage In teacher ratings. The graphs also show that these 
advantages are to be found mcBtly at the upper ability levels; at the lowest 
.there are virtually no differences In teacher ratings and a small 
eSMP advantage in math grades. 

It should be rcted that In all three dlstticts, seventh graders studied the regular 
district seventh grade mathematics eorrlculum; no special arrangements werl 
made to t|<e into accc^ht the special strengths of CSMP students. Thus, the 
^\Tio n'^ -f^SJ" a sense, the "vyorst case sOenaflo". As districts start to .^e 
eSMP district wide, it will be to their advantage to alter their seventh grade ' 
curriculum accordingly, in which ease the long range benefits Of CSMP should be 
more strongly apparent. , • 

Leaving CSMP After Third Grade ; 



In District 21, a^ study of classes who stopped^ CSMP at third grade was carried 
out. The^ district decided rot to begin implementation orTRl CSMP curriculum in 
grades 4-6, so in fourth grade these classes returned to a more traditional 
mathematics program from one of the standard textbooks. 

A_t the end^of fourth grade, the MANS Tests were administered to these ex-CSMP 
students, who constituted seven classes in two schools, and to seven classes of 
similar ability from twO adjacent schools who had never studied CSMP. 



Meai scores on the MANS Tests were^ calculated across ex-CSMP classes and 
across ex-Non-CSNP classes. These mean scores are shown in Figure U 
ofC5"?^f T ^raph of district means generated frOm the earlier Extended 
P lot Test of fourth grade. The circled entries represent the scores for District 
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Fig. 44. Fourth Grade Class Msans, District 21 , 
; Suger irrpbsed on B=T district rrBahs 

= District 21 - [k-3] ♦ traditional t4th grade]) 

. ' (0' = District 21 - traditional 

The graph shows that the ex-CSMP c[a^es had lii^er MANS scores th€n the 
ex-NorvCSMP classes. This difference was significant at .05 on the ANCevA of 
class meanSj though the differej^ces in covajriate scores between the two grbcps 
was larger than desirable for that kind of laialysls. 

VVhen 5r4phs of class means (seven ex-CS seven ex-Noo-CSMP) were ex- 
amined, three. ex'^CSF^P classes had verj^ high M^S scores relative to ability; the 
other four ex-dfeh^ classes had M similar to ex-Non-^^^ elates. 

The three high i^oring classes were jx)t from the same school aid the degree to 
which their tethers ^•followed-up" on students* CSMP Background Is not known. 

The largest differences In favor of ^^ex-CSMP student^^^ fii tWq cate- 

gories: Number Representations, and FRfel^^^^^^ this 
latter category, even thojgh the difference was ^^^^ at ^01, It 

was much smaller than the differences found during the Extended Pilot test. 

This study is snother^dicatlqn of some residual eff^ from jSSNf^ after a year 
away from the curriculum. It alro_indicates that the MA^ may not be 

long lasting if used only in the primary grades without specific follow-up. 
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Dif ferences Accdrdlhg to Sei^-oL 



Nine studies were conducted cdrtiparlng boys* and giris' performance on the MANS 
Tests. For each study, an effect size was calculated by dlvldlrra the boy-girl dif- 
fer enee In m^^ srpres by the pooled standard deviation. This was done separ- 
ately for eSMP and Non^SMP students. 

There were two studies at ea:h grade level except thi^d g?ade (three studies) and 
sixth grade (one study). _UsUaliy, one study at each grade level was based on ill 
data from the Extended Pilot Test at that grade and the other was based dh one 
or two years of use of the revised MANS In 3olnt Research Studies. There were 
an average of about 1 100 siudents per study; I.e., an average of about 275 CSMP 
boys, eSMP girls, Non^SMP boys and Noh-eSMP girls. 

Table 32 summar^^^ the data by MANS category ^d grade level. The effect 

^flP !^^^^--y^--'^^^^^ averages acro^ studies,, with different studies 
weighted according to the number of parUcIpatlng students. 



Table 32 

.^Average Eff«ct_Slss, Boy« viriui Girli 
(riret entry - CSMP, Mcohd ihtry - itohHCraiP) 



Category 




CcRput Ation 



KstJjnatibh 



Hihtal KriUwetic 



Nuaber Reprssehts 



Word Problens 

Elucidation of 
Multiple Anavere 



-14 



-18 



12 



18 



18 



21 



2<r 



Relationahipa & Pacta 07 



14 



05 



05 



-07 



-18 



23 



15 



21 



17 



26 



10 



17 



07 



23 



09 



H)7 _ -11 

-06 -19- 



-07 



-01 



25 



36 



27 



42 



15 



17 



14 



13 



20 



26 



-19 



-12 



08 



27 



10 



23 



14 



11 



05 



15 



26 



-15 -16 

-06 — -06 



-09 



-05 



35 



35 



41 



32 



23 



03 



19 



26 



29 



24 



-05 



-02 



Total MANS 



06 



16 



17 



09 



15 



-11 



-11 



21 



26 



23 



27 



18 



12 



12 



15 



18 



18 



-■11 



-06 
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Girls had higher scores than boys at every grade level, in both CSMP and 
Non-eSMP groups, In twb categories: Computation aid Elucidation of Multiple 
RespoTOes. The difference averaged about 1/10 of, a standard deviation in both 
categories (less at sixth grade) with CSMP girls having a larger advantage than 
Non-CSMP girls in grades 4-6. 

Boys had higher scores than girls at every grade level, in both CSMP and 
Non-CSMP groups, In the other five categories. The difference averaoed between 
0.1 and 0.2 standard deviaUohs in three categories: Number Representations, 
ReJationshlps and Nurriber - Patterns, and word F=>roblems. The difference averaged 
about 1/4 of a standard deviation (sll^tly less for CSMP students) in two 
categories: Estimation and Mental Arithm^tici These differences favoring boys ^ 
tended to be largest in fourth and sixth grades^ 



if one assumes a rSrmal distribution of scores ^tor both boys and girls, effect size 
can be Illustrated in Figure 55 below. 
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Fig. 45. Hypothetical norrral distributions, NPNS scores, _ 

£ = rrean Nf^S score for boys and girls respectively) 

The effect dze determines the separation of ti and d, the means for tSDys and 
girls respectively, in Mental Arithmetic and "Estlmafloh, the .effect size was .25 
(1/4 standard deviation), meaning that _b corresponds to the 55th percentile rank 
on the combined distribution while £ corresponds to the 45th percentile rank. 

Furthermore, an effej:t Sze of .25 may result In a dlspropdrUdna^^ 
boys In^ the tajl of the distrlbation, i.e., abive the 95th percentile (the portion to 
the ri^t of the dotted liheTn the above flgur^. Under th^ assumptidh of 
normal^ distributions for boys and girls, boys would outhurriber girls by nearly to 
1 In the top 5?6 of the corrtilned distribution. ThIsL hypothesis was j^ie^ 
the Estimation category In fourth grade. For _eSMP ^tudents the effect _slze was 
.25 and about 3/5 of the students in the top 5% were boys. For Ndn-CSMP_ 
students, the effect size was .36 and about 4/5 of the. students^ the top 5% 
were Joys. Thus,' to the extj^t that the skills or abilities tested In Mental 
ArithmeUc and Estimatjbh arlprrpdrtaht cdmpohehts of mathematjca| thinking, 
girls as a jroj-p may be^sbrhew^^ and urkler^epresehted In the top 

group of rriathematical thihk(^s. '^ Furthermore, this deficit Is rheasurable as early 
as second grade. 
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student Atti tudes ; 

In the foorth and fifth grade Extended Pilot Tests, students were asked to 
^ complete a series of attltudlnal Items borrowed from the National Assessment of 
Edaeatlonal Progress (NAEP), as part of the MANS testing. 

In fbarth grade, there were three groijps of Items, ndhe of which prodaee^' ^ * ' *SBr 
si gilf leant differences between CSMP and Non-CSMP students: 

Attltade Toward School Subjects (6 Items) ^ 

e\g. Science; tdke In Between Do hot like 

Self Concept and Math (5 Items) ' < ^ ^ 

_ - • W ' ' - — - -- ^ 
e.g, I usually thderstand what we are talking about In mathematics 

True ''about me Sometimes true about me Mot true about me 
Attitude fowarcfe Math Activities (6 items) 

V - _ _ 

e.g. Playing miathematlcal games: 

I like It a lot I like it a. little ^ I don't like it 

No single Item produced ^ difference larger th^ 6 percentage points between the 
two groups^ and responses were vsry close to those obtained from NAEP's 
national sample. . v 

In fifth grade^ ,there were sevS^^ groups df_ Jtems, 'two of which prbdueed signifi- 
cant differences between CSMP^and^ Ndn-CSMP elates. 

1. Math versus other ^ s^^^ this scale was scored by calculating the dif- 

ference between the math "score" and the other subjects "score" (using items like 
the exarrpje given above LJider Attitude Toward SchddJ Subjects). Non-GSMP ^ 
classes had significantlj? higher on this scal-e. Percentage of respbrees are 

shown &i Table 33. For comparison purposes, the results frdmi fourth grade are 
also shown. 

; Table 33 

Percentage ResjDonses for 
Attitude Toward School Sublets 
(First fentry = CSMP, second entry = Non-CSMP) - 

Like In Between Dd Not Like 

Fourth Grade: Math 

Other Subjects'' 

Fifth Grade: N^th 

Other Subjects'' 

'I Average of responses for science, social studies, reading and 
spel ling ' 



58 


57 


29 


30 


12 


12 


56 


53 


48 


45 


11 


12 


51 


58 


35 


28 


16 


14 


51 


44 


35 


40 


13 


16 
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Table 33 shows that there was ''very little difference in fourth grade between ' 
eSMP and Non-GSMP. responses. Fro rh fourth to fifth grade^ hdweyer^ there 
were two changes, Flrst^ fifth grade Ndh-CSMP students liked math as well^as, 
fourth graders had lIAed Jt but JIRed other subjects less; this Is a difficult result 
to explain. Secdn:d, CSMP fifth 'grader^ liked math less but stayed the sarrie In 
other subjects. This finding Is In cdhtrast to teacher opinions about student 
involvement and enthusiasm in which CSMPj compared to |3revIous math cur- 
riculum, was rated at over 4J3 on a 5 point scale in each of grades 4-6 (and at 
least 1/2 point higher than Ndn-CSMP teachers rated their curriculum). 

2. Math Js dpen. CSMP classes had significantly higher scores on this 3-item 
scale^ an example of which is given below. 

Being gddd at pretending helps people in math: - 

Always true Usually true Mot usually true ^ Never true 

Five other scales, containing from 2 to 5 Items, produced r» si ^ 
ferences betwi^en the two^groups.^ Self concept in math^enna 
spiral appraoch^ value of estimation, math Is closed, and nnath is mainly calcu- 
lation. 




: Ie$ts_af_Specffid -i^MP Content 

- ■ -• - _ • 

In e^h bf.grdcJes 1-3^ tests of specific CSMP content were administered to CSMP 
stuttents. The tests were constructed to model the klnc^ (if. .problems thet were 
assifyied"tb GSMP stadehts In workbooks and worksheets- Primarily these tests 
were ihtencled to assess how^ well' Jtudents understood arid could \jse the CSN4P 
fepresentat'lbnal languages (nnlnlconnquter, arrow diagrams, and string pictured). 
Thi? t^estlng was di.scpnt[nued after third gradi? 'because of the difficulty In 
interpreting the data, since there -are no behavioral objectives or standards In 
CSfyiPs spiral ^eurriculum^ and jlnce facility in these languages Is not ai end In 
itself but a ^vehicle for mathematical thinking. . 

The tests were admiinistered as workbook problems to groups of 10-12 students. 
In format and in administration the ta§k was always very similar to what 
students were, used to doing In math class, i.e., a very noh-test like situation. ' 
The total number of students tested was about 300, 600 and 100 students In grades 
1, 2, and 3 respectively. ^ . 



Sgnnple^ items from each grade are given below for each df- thg CSMP 
together with percentage of students getting the problem correct.- 



uages^ 



Arrow Diag l-ams 

First Grade. 
' " (a) 



+ 3 




j^verage percent of dots labelled correctly = 67 
^ (b) 




Average percent of dots labelled correctly = 55. 
? About 25% of the students did hot know how. to dg these questions. 
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Average percent of dots [abelled cori^^^ 

Average percent of .^dents with complete solution = 56 

- . lb) 6uil3 a xpad /rom; 1 to 8 with +3 and +2 arrows, 
i Average percent with a correct road = 58. 




Average percent of dots labelled cbrrectly js 77 
Average percent of students with complete solatioh 



52 



(d) 



^10 




0 



V f 




Average perdient of dots labelled correctly = 74 
Percent of students able to label return arrow cprrectly 



47 



In addition to being able to do harder items in second grade, the percentagfes 
correct increase^, especially among low ability students. For the lowest ability 
group (percentile rank <20 on Reading or IQ test)^ the average percerit correct 
was 49. " 
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Third Gr a de; 



'(a) Item (d) above 



je percent of . dots labelled correctly = 86 

Percent of students labelling retarh arrow correctly 



71 



(b) 






Average percent of dots labelled correctly = 61 
(c) circle the smallest namSer 



7 




Percent*^6orrect = 41 



From second tg third grade there was again substantial Improvement, as in fi) 
and some genuinely hard problems are asked, as in (b) and (c). : ' 

Minicomputer , ^ i^. 

First Grade. . •= 



• (a) .Show 2 and 3-diglt numbers 6n~ the minicomputer: approx TQX correct 

(b) ' Read 2 and 3-dlglt numbers from the minlcornpdter: 65% -correct 

(c) Use minleonputer,to add 2-dlgIt numbers: 45% 

(d) Use • minicomputer to multiply 2X or 3X 2-dlgit numbers: 36% 

(e) Use minicomputer to subtract 2-diglt' numbers: 25% 

About 25% of the students could not do any of the minicomputej- questions 
and about 50% of the students could not use the minicomputer for any l-i-id of 
computing. ' 
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Second Qrade^ — 

(a) glow 2 and 3-digit numbers oh the nnihicbrri(Duter: 76% 

(b) F=lead 2 and 3-digitnambers from the minlebrnjwter: 5556 

(c) Slow numbe^ oh , the Minicbrrputer ie.g. .6, 14^ 24, 60) with 

exactly three checkers: 63% ' 

(d) f=<ead numbers shown in hbh-stahdard fbrm (e*g. nridre thsi one 

checker per square), ones board qnly : 72% 

The lowest ability grou^ (percent rank <20 dh Reading or test) averaged h 
about 46% correct on these Items. ^ \ 

-SI 

Third .<:srade, _ _______ * ^ - - " 

(a) Show 2 and 3-dlglt numbers bh the minlepmpufcS: 81% 

(b) Read decimal numbers from 'the mihiebmputer: ^j50% 



(c) Shovf decimal numbers bh the mihieorhputerc 1SX 



(d) Adding negative checkers to a display tb shbw a a^alh 
number on the mlhiebrhputer: 5G% 



String Pictures^ , - 

First drade- * Draw a dot in the picture to show where the red square gbes 




4 



Percent correct = 39 
S econd Grade, Praw and label dots fbr 2, 3, 7, ID. 
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Average percent correct = 64i 
t.'-' ' 152 160 



Average percent correct = A2. 



f^^^^^i ^^"""^ of students (at least 25%) were 

H^i^L? ^^^^^V'^'V'^S^^^^^^^ questions about the mlnJcor^^^er^el 
diagrams and string pictures. By the end of second grade with hfrder hiS^fJ^o^ 
^^"iJ^ mM stu^ntsmre me to get aboThalf he S cIS^^^^^^^ 

l^iulf -f^ '^"'""'^ '^"^^ ""9^9^ complicated problerr^T wWch' rlS 
facility with the languages; about, half of the third gradeS were ajSessfS S 
these more difficult problems.* y => weie successful on 
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In order to analyze the performance *of^CSM^^ Nbn-eSMP studenh jvlth re^^^ 

to type of /lumber, Items dealing wfth frj^lons and Items deling with declmd^^ 
were analyzed separately. Tg?Ie :34v sft^^^^ correct (adjusted for reading f " 

or vocabulary) for fractions, decimals anS other MANS^ltems. 

' ' Table 54 ' _ 

Percent Correct, Fraction and Decimal Items 



Fourth Grade ^ 

Fractions 
All other N«sE IterrB 



jsurtjer 
of Items 



15 
234 



rrect 




Fifth Grade 

Fradrions 
Declrna^ls 
Al 1 other h^flsiS Items 



64 
29 
221 



63 
71 
62 



59 
57 
57 



Six Grade 

Fractions 
Decln^ls 
All other N«sis iterrB 



57 
31 
336 



73 

71 
67 



70 

61 
61 



On fractlcrj Items, CSMP students had a l^rge advantage In fourth grade (larger 
than MANS Itents overall) snd a small advantage In fifth and sixth grades 
(smaller thgn mans Items overall). : 

On decimal Items, CSMP students had much higher scores than IMon-CSMP students in 
both fifth and sixth grades (larger thsn MANS Items overall). 

Figure 46 shows results for fraction Items grsalxzed by ability le^el of student^ 

as n-.easured by reading or votfabulary (arid dividing students into ^g^ups according 
to published norms). ^ 




^Jl Practibh 'Items 



fie 



(0 



40 




Vbcabulary 
> 
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^igUre 46. Per::ent Correct^ Fraction I tars, ^xtended Pi lot^te^^ 
Fifth grade (left hand graph) and Sixth grade (right) 
(X = C3^ Students i i = Nbn-ca^ Students) 
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0 fifth arade^ the ICSMP advantage was due mostly to tf^e sujDerler perfdrmin5e ; ' 
(qorrpared to Non-CSMPJ of ability students, while in^slxth grade ft wS due 
to the superloir performance oT^H* ability students. In both years^ the gip 
n^^K^nS^^ Non-eSMP p-e?r5rman6e was smaller than It was for ^ MANS items 
combined (compire with Figures 23 and 24). ^ 

Figure ^7 shows similar results fc^r decimal Items. 




80 



10 



to - 



Declinal items 



5B 



40 



Vtocabuiary 



Figure 47. Perceht Correct, Decimal Items, Extended Pilot Test 

FIfthigrade (left hsrid graph) and Sixth grade (right) 
(X = G9vp Students, • = Nbn-CS*F Students) 

These results are more consistent and the CSMP - Non-CSMP gaps are laroer 
than they are for all MANS items combined. : 
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Viii. SUMMARY 



On February 6 and . 7, the eSN/F Evaluation Review Panel met In St. LdUls. ThI: 
was . the only meeting this group held; its charge was to "review the Implications 
of the CSMP evaluation data for mathematics education and to make recqm- 
mendatldhs based on _these Irnpllcations." The members of the^ panel are l^_ted: 
beliDw; their r_eport begins on the next page, ami continues through page^62. 
Aft^r that there. Is a brief discussion of the results. 

CSMP Evaluatlbh Revlevv Panel 



Theresa pehmlah, 

Mathematics Scpervlsor, bracjes K-5, 
Detroit Public Schools 



RDbert Dllworth^ - 
Pfbfessbr iDf Mathematl_cs, 
California Institute of Technology 

Edward Esty, 

Senior Associate, Office of Educational Research and improvement, 
Department* of Education 



S^iirley Hill, 

Professor of Education, . , 
University of Missouri at Kansas City 



Ernest House, - , ^- . 

Professor,- Center for Instructldnal Research 'and E^ii 
University of ijlinols^ 

Staniey Smith, ^ ^ 

Coordinator, Office of Mathematics 
Baltimore County Public Schools 



Jane Swafford,; 

Dean of Graduate Studies, ' 

Northern Michigan University 

Marie Vitale, 

Acting Director; of Secondary Education, 
Ann Arbor Public Schools 
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Cohclusidns and Recommendations- QfJ ixe--E vald ^fiHri _Review Panel 
Overview 



The Cdrtiprehensive School Mathematics^ Program (esf^) is a dramatic curric.ulat 
ihhQVation in elementary school mathematics, /During 
decisions were made about how mathematics should tDe taught. The mcst 
important of these were the following: 

Mathematically important ideas should be introduced to children early arid 
often^ in ways that are appropriate to their interests and level of 
sophistication. The concepts (but rot the terrnlriology) of set, relation 
and function should have pre-eminent place In the curriculum. Certain 
i content areas^ such as probaWlity,_cornbinatc)ries, and ^ometry should be 

introduced Into the curriculum in a practical, integrated miarner. 

The development of rlch^ problem solving aetlvitles should have a 
prominent place in the curriculum. These activities' should generate 
topicsj guide the sequencing of content, and provide the vehicle for the 
develctpment of cdmputation skills.. 

The curriculum should be organized into a spiral, form whidi Vvould 
: combine brief exposures to a topic (separated by several days before tphe 

topic appears again) with a thorough integration of topics from day to 
day. 

Whole group lessons st^uld occupy a larger and more important rple in 
mathematics class and teachers should m prdylded with highly cte tailed 
lesson plans which lay out both the_cdnteot aid pedagogical development 
of lessons. Furthermore, training Irl bdt#f Sie cdntent and pedagogy of 
the^rogram should be made available to teachers, . .. 

These beliefs about ttie teaching of matheirnatics were translated with remarkabie 
integrity into the eventual curriculum materials. CSMP is a moctel of oie very 
distinctive way of teaching mathematics: and Is one of the few that can be 

studied in detail by mathematics ^dUcatldn researchers and teachers. Its 

implementation and evaluatioh In schddls Is^ In a sense, an experimental test of 
these distinctive features. 

immediate gains in student learning or the kind emghasized^ particularly 
problem solving, 5hduld not be expectfed and are unrealistic. Some of £SMP's 
most iripbrtaht effects will be subtle and diffiBe, for example^ residual effects oh 
teachers beyond the fdrmal Implerrientatipn of CSMP, the appearance In textbooks 
of the CSMP pedagogical techniques, problems and languages, and the ijse of _ 
CSMP as a valuable tdol In methods and content courses offered for prq-servlce 
training. M promdte these ideaSj publishers and authors of mathematics texts 
should be l^ouraged ta Incorporate ideas and problems from the\:SMP curriculum 
and teachef. training institutions should be' fnade aware of the program and Its 
special characteristics for preparing ieachers iji mathematles. 



158 



EKLC 



CSMPs Effects dh' Students 



1. The , most impbrtaht conclusion is that eSMf^ does teach problem flying ' 
skills better than the standard textbook carricala. It^cannot Be determined 
whether this result is due to a) the speelai eSMP "Iariguages" (arrows, : 
strings and Minicomputer), b} the eSMP content and curricular organization^ 
including especially Its spiral approach, or c) the classroom methods espoused 
In the teacher training and prescribed In: the Teacher's Guides, Neverthe- 
less^ this finding is a demonstration that ^problem solylnci skills can be tau^t 
successfully by immerslhg students in a mathematldally rich enyironment of 
problems and activities instead of requiring thenrr to learn the different 
strategies in a highly organized, almost algorithmic, form. 

2> -The original CSMP belief that merely doing 'corrputatjohs as part of t^^ 
i^fcproblem activities will develop computational skills as^well as the tradjtipfial 
program does is riot justified by test .data. CSMP students fajl SDmewhat 
behind their peers^ particuJarly In the upper grades with the rrxiltlpllca^^ 
and division algorithms, -Unless teacher^ supple the program withi' : ' 
corrputatlon practice. However, mode^i supplementation of CSMP hJ^'been . 
shown to eliminate this dlftgrehce. Tl^is^ st^plem^ntation can be ddhe.:_ 
cnobtrusively without detracting from trie straths of the prograr^u^t^K^JS^ 
it does, add somewhat to the length of time normally Silocatfed tq^ath^^ 
matlcs. This finding indicates that regular practice in computatSip J^^t^-^ 
necessary for the development of computation skills but such prastl(^«e«d' I ' 
not be In the form of long repetitive blocks of drill work. ■vi]^'v^- 



3. The CSMP belief that emphasizing problems in a group setting and^osing 

problems directly iri the CSMP languages will* develop adequate.^^s !rr wdrid 
problems is justified by test data. Furthermore, CSMP students -are better " 
able to solve more corrplex, multl-gtefj word prc^lems, particularly those 
requiring Inverse qperations. This finding Indicates, that the ability to do 
one-step, conputatlonally-D problems of the type emphasized In' ^ 

standardized tests . (an^ of dubious value) heed not require the heavy 

; emphasis on practicing these problems that exists in many .classrooms. ^ 



4. There are two ways In which The evala&tlon results, particularly in the 

upper grades, probably Lrderestimate the CSMP effects on students. Firsts 
these results arg^ based on usage of experimental materials by teachei% who 
had llttfe CSMP experiencei CSMP student effects should be appreciatively 
larger v^jhen more experienced teachers^ute. the' revised program. 



SeccKjtd, CSMP students probably know rnore mathematics than the evaluation 
results irRd^eate. These results were basicJ on process oriented tests In which 
specific CSMP termfriology and content were consciously avoided, in order to 
be fair to Non-GSMP students. Thus; tests In" the less traditional content 
areas had to be very general, almost Intuitive^ an^ "non-technical". As 
such^they produced somewhat mixed results, for examp^le^ hi^er scores for 
CSMP students bh tests of probability and pre-algefera but qccaslonally lower 
scores bh geometry tesjts. Hdwever, It is to be expected that CSMP 
students wiW perform muehj^ better than Non-CSMP students^on tests of 
cbtitent that Is highly spectfle to CSMP, for example, the concepts of 
randomness in probability, Sid parallel projections In geometry. 

There Is a head fo^^ddltlonal evaluation of the program to Investigate these 
two cdnslderatlbhs. V i 
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5, CSMP has positive effects on students at all ability levels^, Althou^ the^ 
magnitude of the gains Is sometimes larger for highei^abilltx st^^ 
for iqwer ability studehtsj the general result refutes rripy educatqi^J te^ 
that the teachin^P (Df mathematics to liDw ablUty s concentrate 
Almost exclusively on the basIcSj In a direct instruptjonad^^m heavy 
emphasis on rote, "how-to" methods of learning ccylnputatlqnal ^Ills. The 
CSMP experience has shown that these students tenefit ftom CSMPs spiral, 
problem solving approacti just as other students do; In j)ardcul^ 
torlal languages of CSNF allow young students with limited verb^ to 
visualize mathematics concepts that would otherwise be inaccessible to 
them. ' " 



6. The CSMP feature which maj^ be most widet^i applk|^ is the spiral 

: organization of the curriculum. The CSMP qfgi^2fUon^a of 
topics is LTHJSual in th^e degree to wh^Ich c^ce^ across 
different topics and repeat ec^^ segn>ente separated by several days. 

The gap betweeh" segments provides time_ for the rr^terial to "^hk In"; later 
segments provide a natural review of earlier segments (which is very 
different from the massive review often required at the end of an extended 
period of study on' a partlcalar topic). CSMP teachers report that students 
generally like this a(pproach. fsievertheless, it raises quesltiohs concerning, 

* for exam)^, the mastery of concepts which are prereqaisltes in future 

l^essons^,^tW need for reteaching concepts because of forgetting, the adequacy 
of the spiral approach in maintaining skills^ and the ability of the tea(*ier to 
deal with varying levels of uhderstandihg of a concept without recourse to 
tests, built into the curriculum. ' The overall effect of GSMP's spiral cur- 
riculum, in combination with CSMP's other distinctive characteristics, is 
positive, but not enough is known about- how the mechanics of the spiral 
curriculum affect student learrdhg at different points in time. Because 
CSMP is unique In Its__use of this kind of spiral approach, research directed 
toward its specific effects would be beneficial to the whole educational 
community. 



CSMPs Implementation 



1. CSMP maintained the integrity of pqint of view throughotit the develop- 
ment, sbmietlmes at the cost of reduced marketability of the product. _ The 
^ prbgram costs miDre ta adop^t than a textbook, requires teacher training, and 
heeds a skilled and Influential coordrnator to explain its unique approach. ^ 

Nevertheless, it has been used successfully in a variety of contexts, snd^ 

districts have been able to make local adaptations of the program .while still 
retaining CSMPs distinctive and positive features. These adaptations should 

be encouraged; they mold the program to fit local needte and Increase 

districts' sense of ownership of the prosram. r^where^a^^ 
apparent than in the area of teacher training; r^^^^ 

forced to scale down the CSMP-recommend yid have shown 

in^nulty In doing j:hls successfully in many_ different ways. The fact that 
tti^l^cts have continued to lb e the CSMP matedals, in spite of a drastic 
cuftallment in services avail^^ ^lem, supports the developers* decision 
to maintain the distinctive features of the program; 
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2. The role of the jocai coord&iat^ In ImpJerhehtlhg ahij managing the fDfbgfam 
' i" schoo[ d[strlcts js vital tp the success of CSMP; without a skilled and 

^"^iuentiaj person at the helm a solid Irhplerrientatioh of eSMP Is alifiosE 
[nnpossible^ Increasingly, curriculum refbrm has come to be seen as Ibcally 
initiated and local dis_trlcts are reluctant to Impbrt whole programsi. directly. 
eSMP's success In a district depends eventually on the acceptance 'by 
district teach ers^d adrnlnistrators of CSMP's "point of view", for example, 
the spiral approach, emphasis on whole class instruction, and ^ld> problem 
situations. But prior to Irrplementatlon, the cddrdlnator nee* to gain 
consensus for the need to Improve jriatherhatlcs education In the district In 
ways that are consistent with the CSMP approach. Thus^ curricular refbrm 
begins locally; external programs may be ready arid available for schools to 
tee, but they must be perceived as sdmethlng heeded by the district rather 
than merely offered to the district. 

3. The role of teacher training In the progcam is crucial. There is not enough 
evidence available to directly trace th? ^Mj^cts of trainlr^ on student 
outcomes but the experience of learr^^^MP and teaching It i?i the 9 
classroom will probably have a las^'tfflfect on teachers regardless of the 
formal .eurriculum^ they use*? Bot h^^ ^^gjthematlcal knowledge of teachers 
and their skill in teaching studenSPPfeiink should be enhanced. 




An IiTportant part of learning -to teach , CsMp, perhaps' the most Irrpbrtant 
part, cbmes from the teachers' day-to-day e^perience'Sias they teach the 
lessons. The highly pr esc rip Uve nature of the CSM^figiyjer'Ss Guides are 
very ;unustial in the extent to^ which Oi^y specify feFj^^^ssbrWbQtH" the 
sequence of tasks and th^--qdestJortIn5^ techqlques.^^^^^^ 
and in teacher training worksRbpV teachers are expectei^l to^ enga^^^ the 
same kinds of problem living activltjes as their. students, will be encounter- 
ing. It Is Impbrtant to deterrnine the extent to whlcfi teachers have , 
Irrprbved the way they present lessons,^ ask questions^ and deal with student 
responses in Non-CSMP contexts, if this aspect of the Guides promotes 
valuable and geherallzable teaching skflSj then similarly detailed mipdel . 
lessons may be ah effective way of improving teaching generally. 



Not *xju^ Is known about the relattonshlp between teachef^feharacterlstics 
and c^cial aspects of the program.^ The objective teacher characteristics 
investi|ated . during the evaluatibn of the program, such as mathematics 
Ko^h.«,./jyj-^ and teaching experience, appear to be relatively unimportant to 
^ gram's success in the classrobm. Nevertheless, ^eacher success Is' 
oubtedlyjMaated to the teacher's attitudes toward the CSMP^hllgsophy 
and motlvagatfT for teaching It.; For- exarrple, it seems likely that Oie way a 
teacher goes about leading thef class towards the solution of probierns 
affects the degree to whleh* tl^ students will adopt problem »lv&ig' Attitudes 
towards mathematics. This Issue should be investigated and the^ results 
disseminated to (?wrdinators. 
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The status quo of math(OTatics education innovatloh almost 

Impossible. Content and sequencing of topics have always been heavily 

inflyerrced by the very traditional, cqmputationaHy orlen^^^ view of 

mathernatics held bj' many scjiool adnni^^^ and__ teachers. 

Recent increasedj.use of commercial standardized tests^and state and locally 
.mandated competency tests^ together^ with pu^^ of the results 

"of these test s ^ has narrowed the tr ad itiqnal focus f tj ther so t hat ^ to a large 
extent, these tests effectivejy control^ the curriculum. (Arn example of Jhe 
ieffect of this influerpe is the_dec^b[qn b^^ ^nne CSMP teachers to teach l;he' 
traditional subtracUon algprithm in second^ of the. 

fact that CSMP ennpkDysf a different s^^^ Intentlohdly delays its_ 

presentation until third grade. This decision naturally disrupts later learning.) 

This accountability nnovement has placed increased prfe^re oh teachers to 
have^ students acWeve these gdSls, even txj.the exclusion of other less well 
measured goals such as problem) solving, or less well understood content 
such as probability, in the future; successful curricular innovations are 
likely' to be limited to those which can provide advance proof of those 
positive student effects which are valued by the public as represented by 
school boarcte and administrators. : 

• ' . - • . ,- 

The CSMP curriculum is ebrrpatible^ with some recent trends* in mathematics 
and mathematics edueatlbh: ^ 

the call for increased prpbl|m »5ving^'^^ together with 

continued poor perfbrhnanci^'^ Q^lpr^ (indicated by rfeehL data dh 
"nbh-rbutine" problems frol^v'^he: ISStidhal Assessment fbrEducatidnal 
Progress), ^ y ' - ^ 

" the recbmimehded Iricrease'^ih mittlBtJatjCSvreq for;^high school 

graduation, \/ ^^'^^f^^-iv- ^ 

the recognized need to provide teachers with more mathematics training, 

the .burgeoning Use of computers in schools, and 

the increased intapit in discrete mathematics and algorithmic thinking in 
mathematics. - ' 



CSMP*s value will Increase as these trends continue. 
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Discussion 



It is very hard to be neatral about CSMP, and not rnany people are, including 
teachers. .Even the strongest critics must admit that CSMP students are better 
than Non-CSMP students in some kinds of mathematical thinking, regardless of any 
possible shortcomings jn computational skills. And even the strongest proponents 
must admit that CSMP is hard to implement. It is worth considering what aspepts^i; 
of the program are meet important in producing student learning (and should be .t 
saved and exported) and what aspects of the program make it hard to implement"' 
(and should be eliminatedj. To the extent that the answers to these questions \ 
are the same, there is a dilemma. But in the author's opinion (and the rest of 
this report is all opinion), it is possible to keep the, baby and throw dUt at 
least a little oT^ the bath watef. 

1- Teahers don't L^uaUy eorrplete a fuHj^ear's work in the curriculUrh how, 
partly because the lesspns are too long and occasionally require a sa:ond 
day, and partly because teachers take .class time to supplement the program 
; for computayon practice. Partly for this reason, and partly jDecause they 
just dph't see the pointy teachers drop lessons- in Prob^lllty- and Gecimetry. 
Therefcire, drop these, strands, or at .least recluce them by 2/3 or put them in " 
a separate optional block which is not part of the schedule. Reduce the 
longer lessons by elirninating the last third of the lessons. 

2. Teachers supplement, the program , with computational practice this 
supplemehtihg does improve student skills in multi-digit algorithms. 

■ ^^^^^^ build time for computation practice into the ^hedule, add 
wafksheets specifically designed for this which can be sent home as 
. hornework, and^ as ah important psychological change, admit to the teachers 
in the Guides and traihihg materials that there isn't enough corrputation 
^ practice and that it_is all right to spend time doTrig It. 

3. Teachers ^ complain that the spiral is.too loose, i.e., too much time passes 

^ between one instance and another of a given concept; students forget what 
happened last week (or, sometimes, last month). Therefore, close tjp the 
spiral to some extent by reiDrgahizihg the lessons into blocks. Some care is 
required in nriaking this change. Ohe advantage of the spiral is that the 
constantly changing lessons make mathematics class more interesting. 

4. As part of the ^nne change, build in tests at the end of each of these' 
blocks. The curriculum does not now cdhtaih tests or behavioral objectives 
and^most teachers vvoujd like to have them for grading purposes and, a more 
difficult problem, to detej^mine which children heed extra help before the 
class goes on. While it mgjr often be^rue that proceeding to the next 
lesson while children still don't understand the last one is good pedagogy, it 
Is obvious that there are cases where the teachers should stopw^d review. 
Therefore, these tests should contain standards^ at least as rou^ gulijelines 
to help teachers make this most difficult decision. This will not trivialize 
the curriculum and teachers would be free to ignore the tests if they wish. 

5. ip the same spirit, individual lessons should be accompahled by objectives 

ih^ fjirly concrete terms and in some order of priority. Mahy teachers dqn^t 
. heed this help; they can figure it out. for themselves. For other teachers 
it would be very helpful, particularly dgring the rnany occasions wheh they 
must make choices about what to do in the few minutes left, whether to^ do 
another example or not, or whether it's alright to drop thjs portioh of the 
lessdh. 
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6, One recammendatlohj .which has alrea^Jy beep met^ Is the develdprneht of a 
self training manual for teachers. This will be. eodrmdusly useful td-r 
coordlnatOTs^ especially In districts with heavy CSMP usage^. where niw 
teachers have to be trained every single year^ perhSps one dr twd a time^ 
because of normal turnover, - 

1. far^ all the recommendations seem fairly safe. If adopted^ they .will not 

destroy those aspects of CSMP which prdduce such gddd thinRihg skills^, 
namel;^ the CSMP languages, the mathematical situatidns so nicely deyeldped 
in the- T^aGher's Gulde^ arKl ^ student materials with their wdhderful^ 
colorful problemsv But CSMP*§ cost ddes prevent its widespread Use; its 
con^mable materials prevent it from Iddkihg like a bddk (and being iah 
adopted "textbook"). ' ^ ^ 

- -- -- . - - - - _- - - _ - 

Therefore, put all the workbooks and worksheets into a single^ reusable^ hard 
coyer book. Systematicaljy reduce the use of color so that many df the 
problems can be put in reproducible, master form for local dupllcatldn. This 
Is a drastic suggestion and ^w^^ have a negative effect dn the 

CSMP languages, the mathematical situations and the student materials. 

All of these rec qmmendatlons are attempts' to notmalize the program^ at least In 
appearance, without seriously damaging its best characteristics. The conceptual 
underpinnings of the program, the mathematics and pedagogy, ^re very healthy 
and would easily survive these changes. 
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Appendix B 



List of Evaluation Reports 



the present Report is the Slst formal evaluation report dealing v^ith CSMP, 
Two other reports are summary ref>brts> and were completed in 1983 under 
McREL auspices: 



7 ^^"^^^i^s of Evaluation Reports, CSMP 

/ User's Manual for MANS Student Data Tape 

The first of these reports provides a brie-pige summary of all Evaluation 
Reports, 1974-1983, and all Joint Research Studies, 1981-82. The second 
describes the layout, on magnetic tape, of all class, ^.student and item data 
from 1979-82, as well as a complete listing {76 pages in ail) of all MflNS 
Items from the Extended Pilot Tests, grades 4-6, and Joint Research 
Studies, grades 2-5. 

The next page lists the titles of the 48 volumes of the Evaluation Report 
r Series from the' CSMP Exteitded Pilot Test. Each Evaluation Report is 
labelled M - X - N, . ^ 

where M is the year of PiJrbt Study (1973-74 = Year 1.,^ .... 1 981-82 = Year 9) 

X is the type of data being reported: A * Overv^i^ or summary 

., B = student achievement 

C =* non-test data 

N is the number within a given year and type of data. :• ' 1 



f 
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Evaluation Report Series 



1974 1-A-1 Overview, Design and Instrumentation 

1-A-2 External keview of CSWP Materials 

1-A-3 Pinal Sunmary Report Year 1 ' ^ 

i-B-i Mia-Ye|| Test Data: CSMP First Grade Content 

:f 1-B-2 End-of-Year Test Data: GSMP First Grade Content 

1-B-3 End-of-Year Test Data: Standard First Gride Content 

i-B-4 End of year Test Data: CSMP Kindergarten Cbnterit 

i-B-5 Test Data on Some General Cognitive Skills ? 

1-B-6 Summary Test Data: Detroit Schools 

1-C-1 Teacher Training Report ' 

1-C-2 Observations of CSMP Fir it Grade Classes 

1-643 Mid-Year Data from Teacher Questionnaires 

1-C-4 End-of-Year Data from Teacher Questionnaires^- 

1-C-5 Interviews with CSMP Kindergarten Teachers 

1- C-6 Analysis of Teacher Logs 

^915 2-ft-1 Final SuiSnary Re^rt 2ear 2 

2- B-1 Second Grade Test Data 

2-B-2 Readministratibn of First Grade Tedt Items 

2-B-3 Student Intervievra ^ 

2-e-1 Teacher Questionnaire Data 

2-e-2 Teacher Interviews, Second Grade 

2- e-3 Teacher Interviews, Birst Grade _ 

-_ _ 

1976 3-B-1 Second and Third Grade Test Data lYeir 3 

3- C-1 Teacher Questionnaire Data Year 3 



1977 4-A-1 Final Summary* Report Year 4 - 
4-B-I standardized Test Data, Third Grade 

4-B-2 Mathematics Applied^ to Nbvel Situations (M»JS) Test Data 
4-B-3 Individually Administered Protslems, Third Grade 
4^-^ ' Teachei^, Questionnaire Data, Third Grade 



1978 5-B-1 Fourth Grade MANS Test Data . ^ _ . 

5^B^2/ Indiyitau^lly Administered Problems, * Fourth Gr^.^ 

) 5'^-^ Teaicher Questionnaire and Interview Data, Fourth Grade 

1979 6-B-1 Comparative Test Data? Fourth Grade ^ ' 
6-B-2 ^ Preliraiijary Test Data: Fif^ Grade 

6-C-1 Teacher Questionnaire Data: Grades 3-5 



1980 7-B-1 Fifth Grade Evaluation: Volume I, Summary 
7_B_2\ Fifth Grade Evaluation: Volume II, Test Data 
7-B_3 Fifth Gra^e Evaluation: Vblume III^ Non-test ^Data 
7_B_4 Re-evaluation of Second Grade, Revised MANS Tests 
7-B-5 Ach'ievemenfc of Former CSMP Students at Fourth Gr^e 

7- B-^6 Student Achievement, 'Rapid Implementatibh Itodel, 

1981 8-B-1 Sixth Grade Evaluation , Pi;^limihary Study 

8- B-2 Evaluation of Revised^ Secbnd_Gtade,MA^ 1^?^^ 
8-B-3^ Evaluation of Revised third Grade, MiWS Green Level 
8-B-4 Three Evaluations of Gif t^dStu^eht Use ' ^ 

' 8Hj-1 Preliminary Study of CSMP "Graduates" 

1982 9-B-1 Sixth Grade MANS. Test Data - 

9hc:-1 Sixth Grade Evaluation: Teacher Questionnaires 
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Appendix ' . . c 
Submission to the Joint ©issemiration Review Panel 



Approved Mafchrl3, 1984 



VI SUMMARY: 



to agply various 



^^^I!^.:^^.^^^^^ r^"^^ «^.MsIng patterns axKl r^laaohsW,^. TOs claim Li bi^on 

tea ? " ' " " ^ 



va DESCRIPTION OF PRODUCT 



^ed^^ieSfuiftti^ '^^^C^:^^^ '^^^^'^^ fi Siifiei„iu« 
new Sftntent, the Use of sDecS^SSilfeJSS f<>r rei^ar classroom u««e. w^Jch features • 




detailed le^on 
ig'iri length 



nSn'^Sl k"*^^^ ^ 'n^ter schedule of acUvltles 

?Sm ^fi^^ft^r"^^^^^^ between 2 Shd 6 guides p^^^^^^^^ 

fn.m about 500 pages lii Kindergarten to about ISpo^ges^s^^^^ ' 

^S^^^S^^^^ ""^^ to, accdmpanjf individual ites^ and wbrHx^ 
wS^e^L ITS^.^^ lartef units of woHc. There ate between 100 and 200 

worksheet per^grade and between 4 and 16 workbooks per ^ade, deperidlng^dn grade level 



eiaim 



gctlvehess 



1- CSMP students perfor 
Non-CSMP students. 



at Jeast as weU in tradlUbnai arithmetic sidlls as compacable 



^ ar^better c6nij«^ble nbri^MP sti^ients to apply 

the.J,*then,atlcs they have learned to new problem situaujns using process involving: 

Relatiojjs^lMiand ' ^ _ 

v:* Production of Multiple Answers ' ' 

Mental Arithmetic . ( ^ 

• Wordv Problems \ 
- Estimation 

Number Representations ^ _ # ' 

Pre-aigebra V#*^^ . ^ 

Prediction \ ^ * 
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intended Beneficiaries The program Is intended fbr use in regular, heterogeneously-^^^^^^ 
FBh^nsar^ism Vm^mx^m^os cttfiicalmn for about 55.000 students. in_over 166 
sSdTstricts.4nclu^jP®^to^ftea. ehapter-l-. and nbh-EhgUsh speaking students (though 
/' no_£pecfflU£laijris arJ^SHP^^se popaiatio£i|^ 

Materials were 'developed "on a day-t6-<iay basis in 
Louis school district. The classes were near the 



tegular 
national 




an inner subto-ban St. _ 

page is achievement scores ^and and in racial cbmpc^sitiort. . . ^ 

• Fiesources Required The program is to be taught, by t regular classroom <eacfe^ and to be 
iPS^^cally-design^ted coordinator, most^ofteh . district ^^f ^hematics sup^vasc^. . 
. No other peionne,! are reguired. nor is any special .Equipment or f «f ^^^YJ 
classroom Depending on grade level, between 6. and 30 hours of ^ training 
- mended (although not required) and training arrangements are determined by the local district. 
' a network of qualified "turnkey" toners is available to adopting sites-^f desired. 



-l-VDical personnel training costs range from $0 per teacher (for example, when the coordinator 
conducts the training in two regularly scheduled staff development days, tollowed by mon Wy _ 
two-hour in-school sessions) to approximately $350 per teacher (for exampife. when a consultant 
conducts a one-week- wdrKshop for teachers who are paid a daily stipend^. ^ 



The approkimate oosts-pe.r-stJ#dent of all materials, based on present, moderate-sized 
are shown below for kindergarten, grades 1-3 (average) and grades 4-6 (average). 



hg 



runs, 



Table 1 
Materials -Costs Per Student. 



inst allatJdn^ear 



Teacher Materials 
Studetit Materials 



K 



;$1.50 
$3.7^ - 



1-3 




In addition, beginning in fourth grade, ohj 
students. Calculatbrs can be drawn from ( 
provided by students themselves;, 

Vtit BESCRIPTtON OF EVA^LUATION DESIGN 




Subsequent Years 
K 1=3 4-6 



$3.70 — — ; — 

^7.10 - $3.5,0 $5.60 $6.70 

'lilatpr is 'recOffiwehd^ for every two 
iiobl supplies, purchased sep^ateiy.- or 



General E valuation Activities 



The evidence presented was generated by CEMREL'S/Mathematiqs Research and Evam^^^ 
Stidi^s (mIeS) proiect. which operated and Was funded independently of the CSMP d^evelopment 
So^p lis fc£l?S monitored by an iexternal Evaluation Panel chaired by ^ Dr^ Ern^t . 

House. A 50-volume Evaluation Report _SeiieS describes the complete set of evaluation data. 

The initial phase of the ^velopment cycle' of fcsMP materials^ at each grad^^^^^^ i 
a printed Experimental ftsion of the m^'^'^^ l^lJ^^i'^.r^^.^^!^ 



we^s in that grade in w^'t were called/" Extended Pilot Tests ". The ^ year of each 
fxSnded Pilot Study focused on a small number of classes in the St Louis region. This uJal 

was used to obtain preUrninary evaluation results and to develop evaluation procedures and 

Instruments, ^n the second year Of the Extended ^Pfiot Test, larger numbers Of classes in many 



geographic locations wore tested. 



Ex-perirn entai Desi gn 



burine the second year Of the Extended Pilot Tests the curriculum was used in regular , 
-lassrooms under normal conditions. Materials and training costs Were born- Iv part^ipating 
(listric-ts who" agreed to cooperate in data gathering activities. ^ 
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Partieipating sehcx^ls bogan using iSSI^P rhateriais.in the loWer grades: The raost cornmon 

straU^^T>' wai to bcgfiii ail thetr kmder^»ton: or first grade students in CSM'P;. in- each 

succedihg ye^ar those 5>ta?dcntf^.adveche^d' one year in the corricularn wWie^new'j^od^ 
('SMI* t'roin ' thai- iirst ievei; fhQsr iri the later -grades, teachers did not voJan^r ioLJ^ the 
prograriuij'ut more orJ^s^s "inherited' it and their CSMP students trbm the previous JPade 
. Level; ^/For most of these teachers, teaching in the Extended Pilot Test Vas their fir^ 
expt'riene'e with CSMP. 'Jtfey <^^»eived training dctrihg the suinrher or early faJi, throu^ either 
^a <:sM|*-xfih w.orkshop 'd^'S s^rkshop conducted oh site, by the Ipcal CSMP coordinator; 



V 

SThe d(3sigh bt the testing program was comparative in nature: iSontrol classes we^e "selected 
\foiriily-t)y apd the participating districts. Since' CSMP was being used at a given 

grmJi: lev(^l tlirpughout the school, cbhtrbl classes were chosen from another nearby school 
vvith sirnilai' •students and: teachers^ In some cases, particularly in sixth grade, the program 
vy.as L)(uhg us(>d distript-wide and _controi_cLas_ses were rtbt avedlable from within the district. 
In such eases they were selected from- CSMP. schools in other districts, but where CSMP was 
brihfj us(;d btily at lower grade levels arid had_ not yet reached the grade level being tested 
(that is. th(? cciritrbl classes, had rio previous CSMP experiericejf. 



< SMP students usually had beeri studyirig^CSMP since at least "first grade while ^t the same 
liirie the Nbn-CSMP classes had been usirig their district's regular matherriatics curriculum, 
which vvas almost always a cdrhmdrily used math series from brie of the large text>t>bbR 
pUblishiM's. ' , ^ • 

1i*\sting took place in May each year, .Using standardized math tests arid/or the MANS Tests 
('St?e next page). Included in the testing program was a standardized readiril test whose scores 
wen- used as a covariafe in the analysia. Class mean scores were calculated arid ari Arialysi^ 
>rr ( » .varitiiiee was jx.*r formed on the cla^ss means. Students who had entered the prbgrain 
alter (.)etuber. whether CSMP or Non-CSMP. were excluded, from this main an€ 



^"^1 27 school districts partici^pated in these comparison studies, at least 9 per grade 
levejS&yith some .districts .participating at rno^e than one grade level. These 27 districts were 



distTibJited as follows: 



7ypg of Communit y 

7 laf'ge city 

12 suburban 

, ^ 4 medium city 

_ J > 4 sinair'city /rural 



_s 



Geographic Location 



7 ^ast ' 

8 Central 

6 upper in id west 

3 south 

3 west 



Thf uumb(^r of c-lasses participating at each -grade- level is shown in Table 2. 

" r . . : Table 2 _ ; 

* ; Participating TMasses by Gr^ade Level 



Number of i^asses 
CSMP Nbri-CSMP 



('ari Readirig Perceritile Rahk 
CSMP 



11^ c 




42 
30 
31 

2r) 



no 

33 
21 

25 
37 



51 

64 
61 
77 



yph-CSMP 



50 
56 
52 
50 
7R 



hn be s<*efvthat the (:SMp and Non-csMP classes were, well rnatcheU 
e* |)(.4-ng nonsignificant diflerences between tiie iwo.;:Qr^^s. in any yelpiK 



ing ahility, 



r 
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IXa EVIDENCE OF EFPEaff^^^ FUR CLAIlil 1 ' 

Table 3 suriimmws /all of the available data frbril mathematics, cbnip^ tests in^cbnlf 

studies, grades 2-6. The adjusted class" means were calculated Using an' Analysis^ ot" Cbvarif 
the class, means with reading, score as cbvariate. Separate studies were cbriducteii in indivi 
districts, in grades 2 and 3; districts were cbmbined in Jlraifes 4--6. . 



Table 3 

Cbmparisbn Data, i^mgutatibn i;^sts 







N'umber ot Classes 


Number 


Adjusted 


Means 


SiErnif 


In 


Grade ' 


Test 




IN UI I ^OiVi r 


of' Items 


CSMP Nofl-CSMP 


at-^ 


Fa vol 


2 


CTBS 


13 


is 


28 


21.6 


20.3 


* 


CSM 






15 


13 




20.6 


19.3 










6 


6 




20.5 


18.6 




CSM 




ETS Coop Priml 


6 


6 


55 


36.2 


35.2 




CSM 




Stanford Ach 


6 


() 


percentile 


47 


52 




Non-( 










raiiks 










. 3 


CTBS 


12 


12 


48 


36.1 -. 


35.4 




CSM 






15 


12 




35.8 


36:8 




Non-C 






7 ,. 


8 




37.2 


33:3" 


* 


CSM 




ETS Coop Priml 


6 


12 


55 


42.3 


41:8 




CSM 


4 


SAT + MANS2^ 


A-6 


21 


48 


27:0 


28:2 






5 


CTBS 


31 


25 


48 


34.9 


34.3 




CSM 


6 


MANS Computation 26 


■ 37 


34 


27. 0' 


26.7 ■ 




CSM 



(modelled after 
standard, tests) 



iTotal Math; This test does not have a separate cbmputatibh sectibh __ _ __ 
240 items , from the Stanford Ach; Test ^ 8 items on fractions from the MAN^ 

- ' ' ^ ■- ------ 

CSMP classes had higher scores in 9 of the 12 studies, including the only 2 significant 
r^^uits. This supports Claim A, that students in CSMP perform at l-«ast as ^weli as Nbn-CSi 
students in tfaditionai arithmetic skills. 
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iXb EVIDENCE OF EFFECTIVENESS FDR CLAIM 2 

The MANS Tests « ^ t 

Intro duc| .ion * - . : 

The. MANS Tests (Mathematics Applied to Novel Situations) are a .series 'ot\ short tests, 
different _ at _each .gra^ level, designed to assess some of the underlying Uuriking skills^ t 
through CSMP. They were developed by CEMREL because smtabje standardized^ m^^^ 
tests lor ' measuring such skills are not available. Development of such tests 'has been 
recbmmehded by both the National Assessment of Educational. Progress (NAEP 198;i): 

'"The vary things that are ditticult to teach are oiten difficult or expensive to 
test. Hducational Umders need to pressitre test developers -to include items that 
reflect the higher Ir^'ol objective's of the carricuium." 

and /t>y the National Council oi 'Teachers of Matherjiattcs (NC/rM _U)8Uj: 



"fhe evaiuation oi [>robi(Mn-sojving perfbrinarice will denianc} ne^w appr'baches to 
measuring: C'cMiainiy pn^st^nt^ tests ai^^ not ad^Mprnte." 
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At each grade level, the MANS 'fests consist of severaV short tests, eiteh^with ijpS; owil^ * ' 
standardized directibris which a specially trained "tes^^r uses iri"expfeihing-;the task 9 ' ' 

sample items lb the class. Liberal time limits allow?^ almost all snu^^nis to^nl^' For most 
tests, students prbduce theii' own answers instead of selecting from givi?n; alternatives. 'Vtv^^ • 
reading requirements are kept intentionally low relative to grade level. 



Reliability and Validity - •> . 

<i\ ^ . ■ ■-■ _ • 

bev eldpmehtal Prbcedures At each grade level, there were two years of activities Includrng 
outside review; pilot testing in at least 5 local claisses; test and it&m analysis; and revi^ibh. ^ 

Coverage Standardized mathematics tests usually have 3 sections, two of these, com- 
putation and word problems, are explicitly covered in MANS, partially through the "rentar' of 
standardized achievement subtests from publishers. The third section, concepts, is integrated 
throughout MANS. The .average number of matheiriatics items in seven leading standardized - 
tests (CAT, CTBS, ITBS, 1VIAT, SAT, STEP and SR A) is shown, belbW? There ^are at ^east- three 
times as many ndri-cdmputatioh items ih the MAN5 Tests e&^in the standardized tests. ' 

^ ______ _ _ _ _ _ r 

Number of Com putatlbn Item Number of (Dther lteins ' ^ 

I Standardis^a Mi^NS 

34 . - 138 r 

53 , ol08 . 

54 237 , 

55 339: 







Standardized 


MANS 


Grade 


2 


31 


18 


Grade 


3 


.J8 


22 


Grade 


4 


<»39 


48 


Grade 


5 


'41 


54 


Grade 


6 




34 



Qutside Review During test development, all tests were reviewed by the exte^al CSMP . 
Evalaation Panel which included distinguished scholars in mathematics,^ssessm^eht ^ J 
evaluation, and mathematics education. There were also reviews educatibh practitioners. 

Reliability The reUability/internal consis^^^^ (KR20 corrected by Spearmah-BrbwrL for an 
equivalent 20-item test) was calculated for each of the 85 individual Mans 0*5ts. The_ reliability 
was above .86 for 72 of these tests^ between ,75 and .80-fbr 10 tests; and below .75 for 3 
tests (.68, .71, and .7|); The median kR2b was .86. Correcting tor' an equivalent 30-ite_m test, 
a more usual number for standardiz' d tests, produced KR20's above .80 for 83 of the 85 j^sts. 

Correlations with Other Measures The median correlations between Reading scores and^JTbtal^ 
MANS scores were .60, .57, and .56 for grades 2, 4 and 6 -respectively. The median correlatidns 
between standardized computation scores and Total Mans scores was :63. The /nediah coiv- 
j-elatibhs between Total Mans and teacher estimate of student's problem solving ability was .59. 

Student and Teacher Ratings Mean teacher ratings o£ importance of iBdivjWual MANS tests, 
collected in 4th and 5th ^ades, were 4.3 and 4.1 on a 5-polnt scale. Mean ra^ng of how well 
students liked individual MANS Tests, collected only in 4th grade, was 3.G bn C 4-point scale. 

-_ _ - _ - . _/ » _ _ 

MANS Categories Individual MANS Tests are grbuped into categories according to 
mathematical pr^^cess considered by the CSMP Evaluation Pan^l to^be generalized processes 
appropriate to {5rbblem_ solving at_lhe elemehtfiu^y gra^^ Several^| the basic goals espotfied 
by tK>th the Natlbhal Council of Teachers bf Mathematics and thi^»Mional r Council of ; - 
Supervisors of Mathematics3 ihcludihg/'uslhg mathematics to predffiSW^ ' and i'estimatioh and 
approximation" are included as MANS categories but db hot appear fli standardized tests. 
The next . page lists the MANS categories and shows sample items from each category The * 
actual student tbrm at was much more exter^^ and was. preceded by standardised directions 
and Mmple items explained by the tester: Items ih the Estimatioh category had short time 
limits, A few 'item types were repeated,. j^th dift^reht items, in. two or fi^bre grades. ^ 

■ ■ -. 179 ■■ ■. \ ■■ ■ ■ 



Nunibor 



Sampit? of MANS Items l>y .Uradt^ Level 



Fourth Grade 



Sixth rirade 



2 ' io 
ib - 5 



WKich is Larger? 

585 ^ 250 or SBOtm 

What is the missing nuiiit>er? 
28. ^5. ? . 19. 16. 13 



Will 7UU Im» in iiiiy i» 









•1 


M 













Wtiibh iftrgcJ &/2 or 5/4. 

■ 0,9 or OMll\ 



What are thji» ihissilig hiimbers? 
?. 5b. ?. 4^00. 400. 800 ' 



Name _a__fracljpn tdecimajL thau 

larger ilian 1/a but smalj^^^an 1/B 
larger than 0:2 bat sms)[]er chan 9lZ 

- •■'i'' ■-. 

LnM the n^iMfvz riumtMT - 

— I 




Multiple 
Answers 



Write # Sentences about 8 
8 = 9-1 

8 = 2x4 



Take out 3 baUs together 
Add t(f get tbtfU score 
Give ail possible scores 



Menial 
Arilh 



300 - r = 250 



Hit_= ifain 5. miss = lose J 
start with : 3 below zero 
en0-with : I> atx>ve zero: 
# of misses : 2 
i of hits : i 



m-x 75 = 900 
13 X 75 = V 

\/2 X ? = 40 
a:75 - 0,5 = ? 



scratch worj 
not allowed 



_ Word 
Problems 



dne-sliiget with pictures^ 
and read to the students 



iUo-stage^ 

^rf' ■ " _ ^ ':s 

MisceUaneous data 

Word problem approximations 



Ttiree-slage .-^^ 

Word problems with frsetfons. decimals 

Novci word problorns 



E3tirtiaUon 



90 12 is in wtiich interval 
0 - 10 - 50 - 100 - 500? 



602 is about ? as large as 2i«8?- 
2, 5, or id times 



¥ i/2 8 is.' <1 orv-l or 

Which interval contains 1.002/. f 21.5? 
0 - 1 - 10 - - 50 - idb? 



Nuinber 
Repre_sen- 
tations 



Write "two thoi^and. elev/*n" 
100 more than 901 is ? 



How inamy iiM-'tic-s? 



i I 4 









ill 


.1 . 






^ • ^ / . V , i^Jlal' ah atro' 

Kamc the^^nd l«rgesL_4-digit ^^-^ [ 
hunit^r using'orUy 2. 5, 7', 8? > 



h are oqiSvaleht to I/J? 

It/ft 3/15 4/12 / 50/150? 

_ «► : ^ _ 

are equivalent to 3/-^? 
~ 0:075 . 0:75 7:^ - 7^nf? 




|iiir|rni|iiimiiipi| 



spin 100 tiines 
How often is the score 2? 



^ *J?pin I^Vt'spinnttTs together 
/ Hdw often is the toiai > 9? 

/ - -_ _ J- ' ; - . - 

Frorn^ which tx^x'^h^iuid you iiiaKe a -blijid drs«^? 





1 








- «) 










OS 




0/S 




0 (D ^ 




Sixth-Gfade Results 

Uata Will bo presumed iri detiii for thp c.vih •- , ' . ' ' ' 

eHd_orthtf CSMP cUrrieuiaS,:%e^^#e | h'L ^^^^^^ on students at ' 

. >en iOW^e ,jtH be ^ shorter, presentation of data from the 

ie;fmdines across di«H^,>f- ^^^^ .S"...": 



grades to sJvdw the consistency riSsh^ t — ...-•^wii ui aata rro 

Afia^^jS ot: Class Means - - 

as ?bvarlafe. TO fdjuJtsS?rirm "amTuaT?,Vf^^^^^^^ Voiibulai, Test 

and Nan-tfsMP cl«is4' wTL„a,rSl lei thi^f*''^!,-'" scores betwee5 CSMP 




MANS Category : 

Relations, Patterns ■ " 
jvioltiple Answers ^ 
Mental Arlthmetle 

Word Problems 
Estimation 7 
Ntamb^ Represehtaabris 



Pre- Algebra 
Predicting _ 



: Table 4 

Summary Clas§ Mean Data, Sixth Grade 



Total MANS 
It Can ute seen t 



Adjusted Means 
eSMP Non-CSMP 


•|>-vaiu^ 

{i.Bo; 


Effect (difference^ ii^ .idj. means .- 
Stze stand deV^ of control means) 


46.1 

. 38:8 
'-3 1.5 


40.3 
31.9 
28.3 


.01 , 

.01- 

.01 


i.bo ' 

.91 ; 


- • . • 5 . ^ " 


15:1 - 
24.4 • 
28.8 . 


13.6 " 

22,5 
• .26.3 


.01 , 
,01 
'.01 


:56 

-M 

.38 . 




3&;e 


27 .# - ' V, 
V 13.^ V ' 


.01 
-.01 


'47. _ 
.52^ 




; 229.9 ^ 


-T? ^ ^- 

204. 3> 


.01 


.63 





Vid this diff^renc^warslgriftdal^^^^^^ ^jores than Ncm-CSp classes on^ a^ categories 

perforpianoe of thle 63 cflSes % i^s?^^ I* . ^^^^ * the A 

ave,ag. MANS *<S^ plotted ag^St^tSSa^T^^^^ " 




Ik 



of Anal.^s 

Figures 2 and 3 show school and district means. Each entry represents a school or district, 
with MANS score plotted agaiiTst Vocabutary. ^ 

^ tota S^ANS 




'IK 



"^^Tbtal MANS 




M 



Fig 2. 6 th Grade School Me 
(X = CSMP school;. 6 




Vocjlbaiary 

i V, 



Nbh^CSHI^j 



Fig 3. 6th 0Mde E)iati4ct ' Means 



(x - CSMP district, d = Non|CSMPJ 



^ Figure 4 Tabje 5 sfibw^ student jtevel, data. In Figure 4, students are groupegr into 

<^i[rtilQ3 ai»^ to thf iir percentile ;rank on Uie Vocabulary lest. A^ MANS scores are 

.(K^.^^ . ^ • quiurttie of CSMf^^^^ shows MANS r 

^l^dent. ITiese various data show the; advantage of CSMP f^;/ ' 
" is ability levebft and regkrdle^ of sex;* ► ' . ^ 



^scores 
classes 




Table 5 



^Vocahiiipry 



iFtg. k\ Stt4de»%-^eans*t3r^^ i 
' (X = CSMP students, b =,N<5n-CSMP^ " 



MANS Scores by Sex of S"tu<3^nt 

, ^ Boys: 5- 
C^P 160.4 - 
Nbn-CSMP 147.3 

eirfe: ^' \\ 
, iJSStP, 154.3 
NjDn-CSMP 140.j[J 



(X = CSMP, 




A 



CSMP^"Graduat|a 

Sincewthe CSMP ^eyelopg^^nt hasSprtiy Jipehtiy been coifipieted^ there 
"gpOTiates". However, one study wte conduct^ in the ladpgest ^HP site^ the St, LoUis 
are«r Seventh ^ad^ math t^^achei^, ihexperi^hced in teach^,C^MP, were^a^ed to rate their _ 
sjt-udents, who were ^Ixed former CSMP Ifo NjC^ stud^s. Students were ?ated on: 

^ticipation, motlvaticm, creativity and jifoM an^practicaa af^ 

iiean adjust^d corapbsdte ^raUng^for the 55 foVme^) CSMR siji|ents jna^ 'l ' ts^"^ ^'^ ' ^ % 
^ie 210 former NorFCSMP stJd^ diftereSbe wj?^ -I 

• suggestive differenfie gl^ph^^^^^u^al unreliability of such subjective measure?. 

?nts had Mgier mi^jtfSmaJics ^des f ^ flwn quarter^ the . . 
ius 3.6,. 3,8 versus 3.5, and 3,7 fersus S.^H^Jn^ A ^*5,^ B = 4^ ^ 
were signiftcaht "at the .05 level, the <nKr at the .lO/tevel. 



In additibh, forraer CSMPj 
^ad^sted means 
etc.). The first 
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p- 



•9K 



signiricM^^ X;SMP situdents/ pertbrmarice bri the MANS' Tests 
ns on ^t3n9ardi-zedf tests. Usihg effect size oh student level ' 



Educatibrial Sigmfic arice 
In order to assess educatibhai 

was compared* with similar gains'^.. ^x...^. ox^t. ^i. .^LuutrnL u.- 

data,' the CSMP advantage was :37 raw ^seore standard deviations: Oh the five leadijig 
stahdaixlized, tests for ivhich this data was avail&ble,an increase of 1/3 of a raw score. ' 
standard deviation corresponds to en improveSenS^frorri- the 50th percentile to ah averkge of 
th^ 61st perpentiler^nd from the 7.5th percentile to^Qbout the 85th pe*^r>tile. If one 
trafislates the results into simple pefcentag(||terms. Tile gain is from -the 50th to about th^ - 

* 63rd percentile. . , -.^w , ' , 

i-'- • ^ - . ' • , .-i^ - ■ 

. -■ ■ _ _ - ^ _ _ - -- - -- -- — ■ 

• l^e size ofnhe C^MP ^advantage, on the;M?Hi|_'rdsts is also roughly compal^able to two ^ 
tlndings-of natidhal ^ghiticto^ Ihe 49-pgtnt declind in the Mathematics section of the 
Scholastlcy ^titude ^st jerbm 1 963. .to 970 is ec^tflvalent to -abou^^S item? on a 60-item" testr 
or less tha|^l/2o|aJa%scbre^^^^ d^viatiortv Second, the- '^most saU'enT finding^** of the 
recent na$;i^rt^||||lto^^ 1983) was that -^a3-yeax-olds-^ave. ilmp 
^^ti^^J^^^^JIHKPfS wa^ ^bout ^ ^r^^ntage- points) and 

^x^o^^^r^^ a. 13-year-61ds in he.aviiy 



recent nag§rtf^M«ltoh^ 1983) was thi 

d^^m^ti^^^o^'^ wa^s abo 

^har';of 'parl«jaSHBp!^ point gain f 

minprity schCK^ls^^jf^i: - ^ . r-^ \ ^ " ^ - * • ^: - 



Thus J:he CSfrt P. ad vantage^ the MANS Tests is an educationally signtficant result in iteelf 
but more so because of the natiire ^the^ MANS Tests 15*ich are Based on a^pli6atipns.,of 
mathematics to; no.V^l situations: Also^g^^ 1963 .national assessment repbft * 

is -the difficult;^ of making lipprovem'eW in this area (NAEP 1983^ ' : - 



^^Witn^ne exception, . there was. veiySittle change ih_ problem Sbjvfng performance 
beti^een 1979 ^^4^198^^^^ exception, is thatMs^yeaiS^lds shovyed significant 



rgrowth in ^olvfn^ routine_p^blems - i\e;; ^vyprd .prc^)]im ofSthe type usually found in 
tei^books and pTa8ysg|^ sphoql. ..Mdgr of "^the i^tlf^^rllSt problems can b# solved 
by mechanice^iy .appi^r a computational algorithm.. ^K^n tS^ 13--ye'ar^lds, w^b made 
^ • signifteant gains^ ogf ^^e^roblem solving,' showed no cha^^- ih their perlbrmance 
on nbn-rotttfhe .f^^^^ms:" ' • - ^ / ^ ^ 

From , th^^sinii reB^t;|^: a discussion of the ma^^ impateittion of the findings 

; ''Schools are; doirfe a good job of te^ching^^mathematical tbpics that are ^jtetively easy 
tQ teach.;i.' thQ^ was very little chan^ in topics ' that ^e^ relatively djrficult to teach, 

. >'sueh'asfc^ proSlern solving ... 'Ranges i?t thfe higher cognitive tevels will occiii? 

gfhly when Ixtgher-^ev^ cbgi^tive activity becom^^. a cttiTicalar»'fand instiictional focus" ; 




Table 5 shows 
adjustment due 



Grade 





/ Results "from Qther Grade ij^i&eis , : 

sMANS data for ^grades 2^5. Adjusted mear^ are^ven; the size of the 
perehces in^eadihg abiUt^^ w^a^ the larges.t b^ing 1,1^90. 




, _ Table 6 _ _ \ 
SUmmi^y Class Menh bala, Grades 2^5 



Non-OSWP; at 



.01 
' .01 

""-lOl 



Number of Categories 
Tested 

7 
8 



^uitibej? oT Categories 
Sighifica^ < .05) 
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tsF-tests with. 104, ^'1^ and 




degrees of ^j^j^&om 





•y 




Figures 5-8 show graphs of class means for grades 2-5; x = CSMP class, b = Nbh-CSMP. 




^ Total, MANS 



( Fig. 5. Second Grade Class Means 




Fig. 6. Third Grade Cia^. Means 




nA 8. Fifth Grade Bfass Me^ ' 

__ ___A_._ - ' . 

'Figure:^ S'-S i|ltxstrate, ttie cpnsislency with wtfch- eSNfp classes oatperformed cc^ parolee 
Non^^sMP classes. 6|ner analyses "^t jpesef made leyeB show a simiiar con^^^fcy when .tti^" 
data are analyzed at the tndi^dttal sl ^^t ^ >/el by reading score, sex b£.^Stawnt and teacRef 
e^mate of student*s ffoblero splvlhg ^^K^ Joint research studies bet^^hJEEMRSt and 
' imixidued diktriets^ cbjiducted v^tec^^ther tirhies, Uhifbrmjy farodc 
ofvCSMP. ^il^ Jte difference jreac^pikg slghlfl||^ce, in 7 but of the 




latiof 

Assess rife nt: 



Reterehces 

jht^of F.duca^hal* Prbgtess^NAEP). Th e ^Thlrd.^^^tftidnal 
^ Issues/ iJ-MA-Ol/ -i)enver, 



: Edirc*«Ck>hal Ca^isslM pi 



the. State*rl983. 

• l^fiti<Sn&l'^i3w6ljfef ^ of ' Mathematics, w^n Agenda j fgy ^ttdh:, Reeonim^h 

j- Math^rtiaUos I3ff the ^1980% ,'- Restonj- ^^A;: T^ Coui^l, 195a. ^. 'V'-'ir -^fe^ * - 
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/Appendix D 
_ _ _ _ . * 

Description of eSMP ^aterlai^-, 




grades'k-6. , 
f display ^ 



Cu rriculum 

fSi^nJ^^^^y^"^^'^^^^^^ available. in classrwm sets for e 

vvorkbdoks, .^^rksheeCltoryboScs, 
Items, and k variety of manipulatives. " ,yuuu^:,, 

jtatistics, (2) algebrf , and ^3) geometry, at the preH:dllfge ivelf ^" 

a'?Hv^H.f S^i'r"/" tih^jeaching of TTobiem S^^iHg coritaire about 1QQ detiil^ 
^Sh^h ^T^"* ^ i:supple»rienr to the standard curriculum, grades 3-? 
activiUes are based ort CSMP material. ' 



C^serlpti vR N^t e r ials fog Potential Adopteis^ 
The eSMF* brochure Coritiins irSual 
^~The GS^^*NEui^iculUm Flyer ^' A one p^ 



\ 



fbfin^ation in detail. 





: pr^ent^lCTi of reasons for tislr^ 



^la^T for the I^SCs. 



Imstrip -'CSMR: A Problem-Soiving CUrrJ 



CSWP in Action - Manual cBnsisting larg^ olMran^Ipfe of act^ lessdns. 

^^^ri&^ " 5 5;««ar^of CSMP pictorial ?an^^^ 
iM^rand^areas and .all grade levels, and repres^ntpve s^e^t^^C^l^- 

eSMP,j21^ Education - A pamphlet explaining, cImp &age v» gifted 



IUG6|tibh 



1 





A pamphlet explaining why CSMP usage witt^ 



- Jese^iptibfi of materials which may 




location, ah(l^'a.;Sample wo^hop jQ^st-^- -. - 'Cf^^tV^. ; ■ -^^f^^'^^ 



GS(v)P Readability Study - A pa 
^t^P readability^ study 



JSMP Social FaIrris Rep'orjb--i^'pfehl^^ deprlbl^^In'^^teli t 
study to detarmlii^ racial, ^n^er and age equity. " ' 

CSMR Pre-SeFvice/In-Serviee 3|el<^t - A resource boOKie^fot;'^^ 
educators with pre-or. in-servIee"TesponsIbIlItie^ 



ipWefe 'deSfrlblhg' in,u««a^,ir^— . y-. 



I 



Profile of the Corr^r^hereive School MaehemaUcs^Pfbgram ] 
dSument prepared for = the National Corfmlssion on Excellence ':io^ucatIon. 

Scope and Sequence - A K-3 Scope and Sequence %hart arid a pamphlet 
entitled CSmP Sammary of Content, Grades 4-6. , 

infqrmatiqn about Mlhipackage Samplers - A deprlptlon of three CSMP ^ 
^Inlpackages. 

informatibn Aboati)^mination Sets; of Materiais - A lending library is operated 
for the xise of official search committees. 

^ . _ ■ 

Detaiied Scope arid Sequerjce for Grades 

■ V ;• 

Informatiori for TiUe IV^ Adopters •* 



chapter I Resource Handbook ^ 

MiriiQc^a^ges - Descriptions of Wi-computer games, attribute games, and the 
languSg^ of arrows In the sEudy of relations. 



, CSMP Prc^ablHty arid §tatisties - A cdllecti^f pipers di the teaching of ^ 
^probability and stapUc^W ^* . 

■^^^ANS (h^atherhati« .^pS^^^^^ Situations) Test Iriform^h Packet 

• slin)ple Sets of Instructl^S^^terials ^ 

K.,a^h phpI theraDv4«ffi vol^riei^^tlescrlptibri of the CSMP activities and 
""^es usfe^th'F^h W^ft#aaer^^^ ^ "slow learners". ^ 




c 
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Appendix E r ■ 
List of School Districts Partidipatirig in MANS Testing 

-.- • . ' ' 

Arizona, , Globe ^ ^ * Missouri TUdue^ 

Maplewood-Riciimbrid Heights 
District of Columbia ^ ^f^ Norroandy 

I - St. Louis 

^orgia. Polk County ^ tJniversity City 

Hawaii, Wahiowa New Yoric, Bronx 

- • Guilderland 

Kentucky, Jefferson County Hartsdale 

^ New Hartford 

Louiaiana, MissiSsip^i^lSfeate r 

New Orleans Pennsylvania, Phiiadeiphia 

Maine, Portland Tennessee^ Clarksville 

Maryland, Baijtimore County Virginia, AlberinarlS County 

_ . ' 

Wiscbhsih^ Glehdale 
Bedford Janesville 
^'troit Madison, 
Livonia - 
Marquette ^ ?^inihg, Gilette 

Missouri, Archdiocese of St. Louis ' - v ?* 

Ferguson-Florissant : " ; V 




Appendix F 

- ^ ' Individually Administered Problem^ - •. 

At twp grade levels, third and fourth grades^ sets of problems were coHstructed and 
administered individually to samples of students In CSMP and cdmparablS' Noh-CSMP 
classes. The Studies were conducted In, St. Louis area schools durlnQ'the flrsf year 
of the Extended Pilot Tests. . ■ X . ^ ' 

At eah ,|radeVeveI, two sets of problems were developed,: each requiring 30-45 
minutes for a single administration. Sampling was based on a stratified random - '• 
sarrpllng plan based tih «:ores on an ability test, the kuhlman , Andersen I'^st. Half 
of each group of Selected students were given' one jet of probfems, the other half of 
the group took th$ other set of problems. The numbers of studKi^-tested are Shown 
beJow. . » ' ' ■ - ' ' 

- • y . Numbers of Stadents and Ci^sses 

Participating in Individually Administered Prol 

- Nmtier jof Students Test ed^ 




NLrrber of Classes Representee 



Ttii rd Grade: 



ProblBTi Set "A 
Probl^'set 6 



Fourth Grade: Problem Set- A 
Ptoblan Set B 

^ In tWrd grade 
conducted wi 



]7 . 


16 


5 , 


4 


18 


18 


5 ~i 


7 


5D 




5 ' 


5 


24 


24 , 




6 



i^.these ehtri^Bs represent pfflfe^ of^stugents; the .inte^^ews were 
itte.twd students actih^^ as a; team. ^ . 



For^ach individual pr-dblem^Bh protoeal was develpped, pHoted ^and revised.^ 

Student^ wefre .asked to ■ explaih_their answers, or to show wh^, a^mple/problern was 
correct or incorrect. Each inygViSw was tape necbfded arid codeB. < In^ cyrder "^ta in^ 
vestigate CSMP .^Npn-CSMP;di^^^^ analysis of - the responses was carried out 

by assigning scores te: the type and quality bS resbohse ^ • - * ' ^ ^ 

• ^ - N - ^ ' / - 7 . . ^ ^ - 

In^thir(^ grade there were several problems on' wKich CSMP jttfdenk did better Sten 
their Non^C^P counterparts: V . . /. ^ 



;tadShts 



Studlhts were shown a' set of completed calculatibhs which' ^^vstudent at. 
pnother-sehpol"- had -d^^ ^(e.g. 6 X 13o= "53|i They -werV then asked to . * 
raprdly^^ndieate whicfj^swars "could be right" and which ones V\«?re "probably 
wrong'jr • Finally students were^sketf to go back to each, probably-^wrong * 
answer and tell why they though^ the givNen^anssver^was wrong.^ 

SMP students made a hi^er .aver'agg ryrnber of cbrrect decisions (7D% . ' i 
Versus ar^ ^eir. explanations if v^ong^ answers wgre mdreJikelyi'to 

^^(89% ^Tsd^ 97.%). : The-hax^est differences ^between CSMF 

lut ave&ps ability.i 



} 



icceptaWe^ 



>;4Ndhr-CSMP students pc cufred for studi 





be' 
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Students were showrf a partly calendar "^with "59 eeiSts" writt 
day of the week and "told that BlH gets 69 cents every day t 
were then asked to descrjbe the fastest way, oh a calculatbr^ 
"how much BHl would earn by the end ef the week."^ 

CSMP students were more Hkely to^iggest a multlplicatlpfi process (88% 
versus 53%) and less likely : to suggest an addition proces?. - ^ 

.■: ^ - • -- - -- - . - - - - - . 

students v^ef^Sssked to qdlckly estimate the humbe'r of ^ dollar bills that would 
be needec^iit;^jrchase seven items whose costs were as show>i below, "but we 
dort't wan^^o take any more (money) then we'll need": " 'a. 

; $1.22 ' ■ ■ ' ,: 

1.81 ■ 

' . 1.51 / • ■ . ; ' • 

1.53 . / 

1.33 - ^ 

1.33 * ■ . . 

1.39 ■ > 



A higher proportion of CSMP, studehts (509i^ versus 3490 g^ve good answers, 
defined, as 10,1 1 or 12 and.a lower proporti^irt^^ versus 25%^ gave poor- 
answers. I.e., <8, or >1 4. f'^r*' 



wefs,' . 



students were shown ai iridiff erentlated set of "p'eople pieces", which" wete 
simplified flgufes that were either tall, or short, fat or t hint boy or glrj, and 
red or blue. They were then asked^to pat them in ^iles so that all the 
pieces in a pile.wer^ similar in some way and so thiat the piles were all 
different from 'one other. They performied this ciasliflcatioh In as many 
different -wayi as they could. ' ^ 

w _ - -^ 

its "ys^r^ able to make more cbn^e?<' sdrw^ihan Non-CSMP 

iv€rage,"best effort" being 3.0 dimieh|Wns .simultaneously ^versus ^' 
for Norl-eSMP stadqynt^.J //f , / » J 

■ J ■ ■ i ' ' ■■ ^ r 1^':^: V 

•'^ Students v?ere asked to ' figure dul the interviewer's "secret" t^^^ ^ 



'••geople pieces-, 'by offering inTjividual |)iec^ to «hlch the int 

'respond with a •''ye^" or "hd," according to whether the jjytered "piece.. fit the 
- secret/'rule. Examples of the secjcet rule wer^'iblue" and "fat ^d t^h" - .• 

_ - -,:_ -* N ; ■ • -- ^ - -' 

CSMP students -needed to q^m 'fe\^t nieces tq^lgu^e out the rale. In fgur^^, 
^>&is', the ^rage total number of pietes Fieage^was for 'gSMP. afQdfents 
' versus i^ f&- |!%C$MP students. :' - ^ " ^ ' 
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On the remaining third grala prdblemsj^ descriged^ 
no tifffeCences between C^Mf and Non-CSM^ studentsi 

, -kstirffelji'ihg ^e ^rn of "the len (emphasized 

5 ■h.'S + if + s i 3 + 3 \ d + 

Estimate tH% largest Snd smallest 'answer 



if 




r? vi 





3 



\ - 



iate the answer to 6-5 



4i 



Given 1,573. Write the number obtained 'by reversing tHe and the '3'. Is 

the new nqmber iarger or smaller? By about how much? Then reverse th6 

•5' and 'S' and ihe T and "S* (but without writing ttte hew homber) and 
answer the, same questions. * ; 

Flgurfe but , 6 °^ ^ calculator U|lng the 'X' button. Us& 



repeated trials until tijrb correisk^answer is obtftned. 

j Students were ?hdwn' the "people jjieces" problem described earlier, except 
^ that this time, a staridardized seguence of pieces that another student had 
supposedly done was shown together with Interviewer resjsohsei a)dat 
whether they had 'fit the secret rule. Students had to figure but what the 
secret role was, ■ • 

Students had td^term^e the Interviewers "sectet ruie" with the people 
pieces, based c« ^Ing shown; a sequence of pieces that did not fit tW 
rule. ' " . — 

The tdtaL^ean score ie^dss all I^ms^-^^ 50.3 f6r^,Gsr*lP students versus 42.5 
Non-CSMP student^: . The targest' dlffirence occufrfetf: at tte average or sllctitl 
average Sjlllty levelss ' ' - x -^^ 

- -- - -.- - ' \. . __^__ t > 

FourthGra^^ Oh two the problems in fourth grgde^ C^MP- studenifs H 
si^jficahtJy higher scores tjslng At^aly sis of Covatiisi^e on class means 



Students sec^tly e^^ 
the number 2 ^Jf"'" 
number. The ^est 
numbirs, rpultlples j 
questlijn itself was^ 
nuirft^r Was lesg. tharT 
TO t i:' good quer 
C^MP versus '7.4 




tnomber out of a hat (but the^ Interviewer 
jsriswered a series of questions about their iicret ^ 
^ealt with concepts oX order, vy hole rajmbersir negatlyg /" 
-^isbr^. . Th^students were aiso_ asked ^ whether ; t he L 

(F^^mple, after flf)^ing out that the HP - 
^i)ut whether ^t '^was less thsi> 200 



scores, q|j^of eleven, "were 9^ fer ' / 



Stuetents were given 5heeb of graph paper^wlth different wa labelling 
the lines and som|_lIhes heav^ej than ^ers.^ An example Is shown b|lbw. 



V 

4k 
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.stutJehts to figure out hdv^. _ 
ily to Use , a length-Unies-wIdth 
hUmbers in the rnafglns versus 
also better able to do reiated 
vere combiried or when one of 



CSMP students . were be|ter jfcle than Nonr| 
many little' squares were shown, were rhol 
method^ and' were HTor^* likely to tee the ^ijj 
a onS^-at-a-tlme counting process,' They wer^ 

problems of figuring out the area when pieofes _ . 

the figures hati^^ixjle" in it* Finally thew were better able to figure out how 
mar^ squares werl^ oh a partly hidden rol^ of paper marked off at every 
second square. 

^On the othgf four problems, GSMP students had higher adjusted scores but the 
differences were not sigrtifieant. ^ > 




StucJents were given a calculation to do mentally (e.g. subtract 244jfrom 
543). eSMR 'Students got more problems correct {5%% versu ^4 8^j|-^nd were 
more likely (33% venus 22%); to yjse a method other than f or 
•exarnpSe; 543 - 244 is 1 less than 300^ i.e.^; 299). 'liwU 

Students were shown a cdnlputationrproblem (e.g. ^ 

^hree oth?r cbmpUtatipn problems (e.g. 277 + 177) a^^^ecTHf and how.: 
the ^swer to each 6f those three would help with the original prbblem. 




\ _ 



Students were'-shown a series of subtradtion problems (e.g^ 260_ 211}_arkj 
asked to quickly indicate which interval (Q - 16 - 50 100 -/5iXI - ICBO) ^ 
contained tfee answer. * :^ . ' 

Students were asked • to Jcjehtify the Interviewer»s sa:ret rwmber, which a.N?vas 
between 0 and 99^ by: a^sUlng a series of !*yes" dt ''ho" questions. 

^ -- - '_ _ _ - - _^ 

The adjusted totll ^ores across all iterns were 32.1 for CSMP versus 27.6 tor 

Non-CSMP. ^ '""^ ' ' ^ ' * ' 





V 
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Abstracts of IVJANS lists 



y This appendix gives an abstract :ahd_$a^^ for_Jf>dlv_Idual MANS tests used li 

/ any^of gfad?^ 2-6 In the revised MAHis tests (revised 1981-1982). The tests are 
grdtp^ by^Btegbry, and the categories appear in the foUbwihg order* 



i 



Prdcess Categories: 

C: Computation 
E: . Estimation 

M: Mental ArithmetlG 

N: Number Representations 

R: Relations & Number Patterns 

U: Eluckiatjon 

W: Word Problems 



Special- Topic Categories: 

A^ ^. Algebra 
G: Geometry 

s0:^ Q^anizatibh of Data 
, Problt^IUty 
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G-1 



Cl Whole Namber Eemputatiori 



Abstract: Given straightforward cdmputatidh problems involving whole 
numbers, prbduee exact answers (by calculating on paper if 
necessary). The items do hot have the multiple choice 

^ response format but are similar in range and difficulty to 

those found in the standardized achievement tests of the appro- 
priate grade levels "^^^^ 

dfade bevels: 2, 3, 4,' 5, 6 

E^xamples (from Grade A): 



352 
+683 



675 
-469 



143 



6T49r 



€2 "Fraction Ebmputatibh , 

Abstract: Given straightforward cbmputation items involving simple 

fractions, produce exact answers (by calculating, on paper if 
necessary). Though the itetflS do not have the multiple choice 
response format, they are Similar m range and difficalty to 
those found in the standardized achievement tests of the appro- 
priate grade level. 

' - -•<- - ' ' ' • " ' 

Grade Levels: 4, 5, 6 • 

Examp1es^(f rom Grade 5): ' . ' 



3 



1 



1- 



1 



1 



C3 Decimal Computation . . ' 

Abstract: Given straightforward computation iteire Involving one and two _ 
place decimals,' £Foduce_ exatt answers (by ealculatihg on paper 1f, 
necessary). Though the Items do hot have the multiple choice 
response formatj they are simlTatir^ range and difficulty to 
those found In the standardized achievement tests of the appro— 
; pp^^e grade level. ^ ' 



Grade Level: 6 

Examples: 0.5 +"0.25 = I 1 



5 - 1.5 



a.5 X 6.5 



res 



G-2 



Category E: Estimation 



El ? or 5 or 10 Times 

Abstract: Given two numbe^-s, quickly estimate whether the first is about 
2 or 5 or 10 times as large as the recdhd. A sample is worked 
eollectlvely . * . , 

Grade bevels: 3, 4 • 

Examples (from Grade 3): 65 Is about times as large as 12 

98.1s about times as large as 51 



E2 Estimating Ihteirvals: Addition 

Abstract: Given a computation problem involving whole number addition, arid 
5 fixed intervals (0-10, 10-§0, 50-100, 100-500^ 500-lOOrf), 
determine which interval cdntaihs the ariswer to the problem, and 
put an X in the interval, /fiy iristructiori, format and short time 
limits, students are discouraged from eomputi rig exact answers. 
Two of three sample items are dene cdl lectively^ 

Grade Levels: 2^ 3* 4^ 5 " ' . 

Examples (from Grade 2): 51 + 53 ' 0 10 50 . 100 500 1000 

189 + 273 b 30 . 50 100 500 1000 

r 

E3 Estimating Intervals: Subtraction » ' 

Abstract: The scale is similar to E2 (except that it irivdlves whole riijmp*> 
subtraction) and follows tt directly in the test booklets. 

Grade Levels: 2, 3, 4 " * 

Examples (from Grade 3):^ 93 - 86 q 10 50 lOG 500 . lObd « 

147 - 99 0 10 50 100 500 1000 

E4 Estlmatlhg Intervals: Hultlpl Icatloh 

AbstracU the scale Is slinilar to E2 and E3 (but Is devoted to Soltlpl ica- 
tlon with whole numbers for the most part) and follows them In 
^ the test booklets. 

prade Levrffs: 2, 3, 4, 5, 6^ - - 

Examples (from Grade 4): 40 x 10 0 lo' 50 100 500 .1000 

4 X 29 6^ 10 SO 100 500 1000 



E5 Estimating Intervals: Division 

Abstract- The scale is similar to E2, E3 and E4 (but is devoted to djjisiori' 
Abstract. The seal p^^^^ are only four fixed 

intervals (0-1* 1-10. 10-20, 20-100) in the response format. It 
follows E« in the test booklets* 



Grade Level: 5, 5 
Examples: 1 7 15 0 
101 ? 9 0 



io 



20 



100 
160 



E6 



Estimating Fractions <, *, ^l - - ^ issc* ^nsVif 

Abstract: Given a calculation ( or :) of ^''^ "^f 

which is a fraction or mixed number), quickly estimate whether _ 
the answer would be less than, equal to or more than 1, Students 
are encouraged to work quickly and not to compute^exaet answers 
before making their choices. A completed sample item is 
lyidedi 



Grade Level : 6 







* 

Less than 1 


CHECK ONE 


More than 1 


1 








4 ^ 


3 


> 







i 
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CategdVy M: Marital, Arithmetic 



Ml WhoTe Number Open Serrtenees 



Abstract: Given an open sentence, WHfere the! box may be either on the right 
or the Jeft of the equal sign, where the numbers are large and 
easy to work wnh, and where only one dperation is used, put the 
number in the box which makes the sehtghce true. By instruction 
arid prompting, students are discouraged from -computing the long 
•t^'' way" and are not allowed to do any figuring on paper, 

8r?(fe Levels: 2, 3, 4, 5,' 6 



H2 Above and Below Zero 

Abstract: Given a starting score (which could be above or below zero)^ and 
how much the score went Irp or down, select the correct final 
score (multiple choice). 

Grade bevels: 2^ 3 ^ \. 

Examples (from Grade 3) \. 
Score at the start: 3 below zero " 



Examples (from Grade 3) 



500 + I I = 800 




I I - 150 = 50 

2 X 200 = j I 



Then: Lost 4 



Score at the end: 7 below zero 1 below zero 1 above zero 7 ibbve zero 



Score at the start: 2 above zero 



. Tfi€n::-z±ost 4 ; 
Score at the end: 6 below zero 2 below zero Zero 2 above zero 



V 
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M3 Negative Hits and Misses 
Abstract: 



Given the deseriptibri of a "game" with two rules a) each hit 
means a gain of 5 points and_b)_each miss means a^loss ^ 
Soint) and partial infontiat.i on on the outcome of turns^ .th| 
Student mast deduce the missing infomati^n. Two sample items 
are completed collectively. 



Grade Levels: 4, 5» 6 



Examples: 



Started with 
a score of 



Pam: 



John: 



4 above zero 



Number 
of Hits 

m 



Number Ended with- 

of Misses a score of 



p abbve^erd 



15 below- 



3- u 

= -10 



Abbvt nr« 



E - 1 



E-10 



(provided, 
but not 
mentioned in 
instruetibhs) 



M4 Fraction Spen Sentences ^ . 

Abstract: Siven an open sentence ^ "vol vi ngat least^o^^^^ one 
of the four arithmetic operations, complete the sentence. 



Grade Level: 6 
Examples 



3 i 



1 — 



- 3 



M5 Decimal Open Sentences 

Abstract: Given an open sentence involving at least_onedeci^^^ and 
one of the four arithmetic bperations, complete^ the sentence. 



Grade Level : 6 



Examples:, 



0.5 



0.75 — 



0.5 



V) 



1B7 

6-6 




Gategdry N: Nbmber Representations 



Nl Writing Whole ffcrribers 



Abstract: Part I: The student must write numbers as they are read aloud 

by the tester. 

Part II: Given a nurnberi written in the t 

jpust Write the number which is 1 (or 10 or 100) more 
than it. A sample item is worked collectively. 

Grade tevel t 2 
Examples: Part , I: 



Tester says, "Eight hundred twenty** (repeats) 
Tester says, •*Seven thousand s|xty five" (repeats) 



Part II: What number is 1 more than 999 



What number is -10 more than 495? 



N2 1, 10, loo or lOOOsMore 



Abstract: Given two numbers, decide whether the fprst number is about 1^ 
10, 100 or 1000 more than the second number^ (None is exactly 
right,) Two sample items are wdrlced collectively. 



Grade bevel 
Examples: 



1 

10 



4,265 is about 



100 more than 4,;254 
1000 : ^ 

1 

10 



1,001 is about 100 more than 998 
. 1000 . 



%98 
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N3 Cbhstrycti ng Numbers^ 



Abstract: 



Given the use of *on1y four digits (2^ 5* 7 and. 8) and the rule 
that no digit be used more than once, cbhstruct numbers like the 
smallest (or larges±1, the second smallest (or largest) or the 
closest to a gi ven^numb^r. Tlie constructed numbers are to be of 
either 2, 3 or 4 digits and sometimes restricted to a given 
range of numbers, eolleetivelyi to clarify the rules, two 
i^ncorrect answers and the correct one are examined for two . 
sample prob'^ems. \ ^ 



Grade Level : 4 
Examples: What is the 



/ 



irqest four digit number? 



What is the smal lest three digit number between 
— ^ — 730 and 850? 



What four digit number between 2,090 and 3iOOO^is_ 

closest to 2,800? 



N4 '^Representiog Fractions 



Abstract: The s^ale has five short subsections each containing one of two 
Rands of items: a fraction or mixed number Is given in standard 
form and must be represented in another specific way or else 
. > that process is reversed and the^ response fbrniat is muUiple 
choice. Ihstruct;iorr is largely in the form of a written 
question or comnSind at the beginning of each subsection. 



Grade Level: 4 



Examples: Put an. arrow at <y inches. 



|.|i|.,i|i,i|.|ijHij. 



3 In. 



4 In. 



5 In. 



6 In. 



How much is shaded? 




X 



i 



2 



3 

r 



G-8 * . 
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N5 Representing Fractions and Efecimals 



Abstract: The scale has five short subsections each coritaihirig one of two 
kinds of items: either a mixed number or' decimal is given 
in standard form and must be represented in another specific 
way or else that process Is reversed and the response format 
is/multiple choi.ce. Instruction is largely In the form of a 
written question or command at the^beginning of eaeb subsectibri. 

Grade Level : 5 , 6 ' 
Examples: Put an arrow at 1.35 inches. 



rrn| i i ii| i ii i | i iH|iui:|Mii|iiii{iiiij 
0 I 2 3 * 



How much is shaded? 




7 



1 
7 



(A completed sample was given.) i 



none of these 



N6 Equivalent Fractions and Decimals 

Abstract: Given a fraction (or decJmal) determine /which members of a set of 
fractions (or decimals) ^re equivalent to it. A sample set ^ 
of four completed items is shown. 7 



Grade Level : 5,6 



Examples: Circle all the fractions that are ^qual to the oni in th^box. 



2 
I 



9 

T7 



4^ 

5" 



T5" 
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Category R: Relationship & Number Patterns 



Rl Solving Number Rules, ^ * ^ . ' • 

Abstract: Given 3 qlues (i.e., pairs of numbers) ina gamei detemine _what 
- * the secret method Is (i.e., the unique rule relating each of the 

^ pairs of numbers) and then use the role to calculate the misislhg 

number from the fourth pair. 



Grade Levels: 2, 3, 4, 5, 5 
flxamples (from^ Grande 3): - 



First clue: 
Second clue: 
Third clue: 
Question: 



Maria's Game 



Class 
said: 

5 - 

7 

8 

2 . 



Haria^s 
answer: 
Id 
12 

13- 

□ 



Jim's Game 

Class jitti's 
said: answer: 



2 
5 

□ 



6 
9 
14 
12 



R2 Using Number Machines 
Abstract 



Given labelled "number machines" 1 h sequence ^and either the 
initial or the terminating hurhber^ detennihe the other number. 
There is an intrdductibri showing that "number machines" t§ke in 
^ numbers; add, subtract, multiply or d_ivide by a fixed quantity;. 
anS give out the resultant number. Then thre^ sample items 
(each with a "number machine" sequence) are worked collectively. 



Levels: 3, 4, 5, 6 
Examples (from Grade 4): 



xS 



I 



-r2 



R3 Sequences 



Abstraet: Given ah ihcomplete portion of an additive seqtience of numbers, 
determirie the missing number. One sample Item is worked 
collectively. ' " , - 



Grade Level : 2 
Examples: 28i 25, 
^ 1. It, 



19, 



2. 



16, 

3i 



13 

3i. 



R4^ Which Result is Larger 



Abstract: Giyeri two quantities (usually similar computation problems 

^ using or x) mart the one whic^h yields the larger result, 

^ ^ or marfe them both if they are equal.; By instruction, format and 
time limits, studejits are^discouraged from computing exact 
> answers. The correct response should be more easily determihed 
* by inspection than by computation^ Two sample items are worked 
collectively. 

Grade bevels: 2, 3 

Examples (f roij^^Grade 2): 585 +^250 Q 3 x 31 | | 

. ^ 580 * 290 Q 31 X 3 Q' 



R5 Labelling Number Lines 

' _. _ . / _ _. . 

Abstract: Given partially labelled number lines, w^th vairylng increTOn^ 
determine certain missihg numbers. A sample item is worked 
J!: cdl lectively. 

*» 

Grade Levels: 2, 3* 4^ 5, 5 _ • 

Examples (from Grade 2): . ^ 



■T 1 r 1 r— 1 1 T" 



"T "T 7" T — I 7- 

20 24 28 32 35 



R6 Multiplicatidh Series 

Abstract: Given ah Incomplete pbrtiSh of a maltiplicatjve series of 

numbers^ determine the constant jnulti pi jer involved 1^ order to 
cbmp-lete thes pbrtibh shown. Portions of several series are 
shown altogether with one, two or three numbers missing from 
each\ A sample series is examined and completed collectively. 

Grade Level : 4 >l *' 

Examples: 



202 



R7 Which Fraction is Larger V ^ : 

Abstract: Given two hdh-whole numbers written |n ^ractjonal fonn.( a proper 
frACtibrij ah imprdperfracilgn or a mixed namber), circle the 
larger one. A completed sample Item is shdwrii 

*\ • . • ■ ■ 

Grade Level : 5. 6 ' 

Examples: J •"^ 

1 . 5 ' 

R8. Which Decimal Is Larger 

Abstract: Given two non -whole n ambers written lb decimal fom^ circle the 
larger one. A completed sample Item Is shown. ^ 

Grade Level: 5^ 6 ^ • 
Examples: 4.999 or 5.1 

1.5 or 0.58 - ' 

Rg Fractions Between Two Others * ' 

Abstract: Given two fractlohs^^ write another which Is larger than the 
first and smaller than the second. 

Grade Level : 5 

♦ 

Examples: is larger than 3 ^ but smaller than "J* 

- - i - -L 
is larger than ^ ^ but smaller thari 2. 

r 

RIO Decimals Between two Others rV 

Abstract: jGiveh two decimal numbers, write another which Is larger than the 
first and smaller than the second. • 

Examples: is larger than 1.25, but smaller than 2.0 

i Is larger than 0»42| but smaller than 0.43 



Category U: ' Elucidatidh 



Ul Number Sentences About 8 . . ♦ 

1 • 

Abstract: Students are to produce as many differeht_''sent§rices about 8" ^s 
possible, always in the fdnn * Four >eorreet answers to 

- similar exercises about 9_are examined colle^xively. 

(9 - Id r !• 9 * 1 + 5 + 3i 9 * 3 X 3i 9 * 18 - 2), 

Grade •LeveT: Z 

Example: My number sentences about 8. • * 

8 t -- - - ~ : 



U2 prbducirig Many Answers ^ 

Abstract: Given several different situations each of which poses a problem 
for which there are many correct solutions, produce^ as many 6f 
them as pQssiblei For each situation, some potential solutioHs 
are accepted or rejected for not following the given riiles as 

_ inappropriate. 

Grade bevel: 3, 4»-5i 6 ^ 

Eiarriples (from Grade 3): 

Rules: Take out two balls. 

Add the two numbers to get a score. 

What are the possible scores ?-6i 2, 35 

Rules: Write all the two- digit nunfiers you can. 
Use only the dTgTt]5 1, 2, 3. 

r Give all the numbers that follow the rules. 34, 22 



U3 Getting to 12 

Abstract: Given a starting point (0), a goal (12) and two^rgles, invent as 
many ways of reaching the goal as possible. The rules are that 
only the numbers 2, 3, 5 | 7 can be used along with addiJtions 
subtraction, multiplication or division. Two sample solutions 
V, (see Below) are worked collectively. 

Grade Level : 6 

Examples: _ 

Sample 1: 



9 12 " 7 _ 

7 x-l « 14 

14 ^ - 12 



eategbry H: Word Pndblems 



Wl One Step Word Problems 
Abstract 



Solve word problems In which the story (including the question) 
is read by the tester while the student looks at a series of 
cartoons and/or follows the stcry [n the captions beneath the 
cartoons. Seven items require dne^tepj solutions; two items 
require two. 



^ Grade Level: 2 
Examples: 





dill spent 6^ to 
buy some bananas. 



BahaHas c^Vt 
2i each^ 



dw many bananas did 
she buy? 




Jim found 3 
marbles but 
he lost 4. 




And now he 
has 5 marbles. 



How many marbles 
did he have to 
begin with? 



W2 Two Stage Word Problems 

Abstract: Solve word problems in which the solutions require twD opera- 
tions^ The numbers in the problems are relatively small; the 
cbmputatidhal and reading requirements are simple. 



Srade bevels: 3^ 4^ 5* 
Examples (from Grade 4) 



Pam gets SOflf each week. 

She always spends 30€ and saves the/rest. 
How much will she save in 4 weeks? 



Tom has Sjf Bid re than ton. 

Tom has 5i less than John. 

If John has'TD?', how much does Ann have? 



131 
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W3 MiseeVlanebds Word Problems 



Abstract: Solve word problems which are unusual for third graders in 
ft one of several ways: requires three-stage solutionj requi^ 

working backward from a given final stateto a 
* state, regy ires more 'logical analysis than straight computation, 
involves proportional ratios, involves extraneous data. 

Srade tevel : 3 

Examples: fit' firsts Sally had some marbles, 
JHeni she lost 3 of them. 

Thehi she found 2 iMrbles._ " ^ *^ 
: After thati she still had_8 marbles left. 
^ How iriahy did she have at first? " 



Sarri has to move 10 boxes. , 

He can carry 3 boxes each trip. 

How many trips will he need to make? 



W4 Extraneous Informatibn 

Abstract: Solve word problems in which extraneous ihfdrmatldh is given. 

0nce the relevant information is selected^ the sblutibhs are 
simple one-step problems involving sm^ll whole numbers. 

Grade tevel : 4 

Examples: A belt costs $4. 

A shirt costs $5. 
A hat costs $1 6. 

How much more does a hat cost than a belt? 



Peter has $10. 

He needs 4 pounds of candy. 

Candy is $2 per pound. 

He is buying candy for 6 people. 

How much will the candy cost altogether? 



W5 Fractional Sugar 

Abstract: Solve word problems each of which start with cups of sugar 

The dhe-step solutions all require simple computions (+, x 
or* -j with fractions or mixed numbers. 

Grade Level : 4 ^ ^ _ 

Examples: Tina has *x cups. 

She buys s\ more cups. 

How much sugar will she have then? 



Kari has 4-|r cups. 

She gives away half of it. _ 

How rtiariy cups of sugar will she have left? 



W6 Three Stage Word Problems 



Abstract: Solve word problems In which the seldtibn requires -^hree opera- 
tions. The .problem is stated in 3 to 5 short sentences and the 
numbers given in the problems are relatively small. 

Grade bevel : 5, 6 

_r _ i 

Examples: Shirts c.bst $10 each and ties cost $5 each. i* 

Altogether doe spent $35 for shirts and ties. 

He bought 2 shirts. 

How many ties did he buy? . 

Bill Toads 6 bbxfs in 2 hours. 
John loads 4 boxes in 2 hourSi 

Together, how many boxes do they load in 6 hours? ^ 



W7 Decimal Gas • ^ * 

Abstract: Solve word problems. each of which start with 6.5 gallons of 
gas. The bhe-step solutions all require simple cdmputatidhs 
(+, x^ or -) with decimals. 

Grade bevel : 5 

Examples: Peter has 6^5 gallons.. 

Then he spills 1^2 gallons. _ _ 

How much gas will he have left? , r 



Ron has 6.5 gallons: 

Next week he will use ten times thH much. 
How much gas will he use next week? 



W8 Novel Word Problems 



Abstract: Solve word probl.ems which are hovel for sixth graders in one or 
two of the following ways: involves fractions or decimals, 
requires mbre-thah-three-stage sdlutidn,, answer choices are 
approximate, requires sol^vihg for two uhkhowhsi requires the 
use of data which is common knowledge but not given in the 
^ problem. Response format is multiple choice^ 



Grade bevel : 
Examples 



Ellen saw pepper plants on sale at 3 plants for 40flf. 

She bought 12 plants. 

She usually bought 3 plants for 50flf. 

How much did she save? « 

2W 40^ m $1.60 $2.00 

George's father gives him 2(i for every hour he spends in school. 
About how much would he have givep George for the month of October? 

$.50 $1.00 $3.00 $6.00 $10.00 



Category A: Algebra ( 



AV -Algebraic Symbols 



Abstract: Given the numerical value of a letter (or letters) proauce the 
numerical vdHue of an expression Involving that letter ^(those 
letters). In written instructions ^ two sample items are worked 
gut and impliedmultiplicatidn (e/q, in 3bc or in d^) is ex- 
plained. This scale follows A2 in" the test booklet. 

Grade Level : 6 

Examples: If g « 4 and h * 3 then 5gh * 

. If p = 2 then p5 « _ _ 



A2 Sol ving >£quat ions 

Abstract: Given simple equations in one unkn^nj solve fof the unknown. 

Three, sample items are worked cdlleCtivelyj including one with 
i a parenthesis. 

Grade Level : 6 . ^ 

Examples: (7 x h) + 1 «^ 15, s6 h « ~ 



(n + 1) A 3 « 6, so n « 



A3 Surrmatioh Operator 

Abstract: Given an open sentence involving one or more sarSnations of 
'consecutive integers, select the^ahswer that completes the 
sentence. A sjSnbol for such summations (^^'^T^J.ls introduced 
and explained ?@-r^= 2.-^3-^4 4 5+4^^ and 'two items are worked 
collectively. ^ ' , ^ / 

Grade Level : 6 ^ * 
Examples: 




.9^ 





-50 .'^^SO 
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A4 Trahsf dnfidtidhs 



Abstract: Given two different transforrationsj"^ which tarns a design 
clockwise by 90*^ and X which reverses the nurobe^^ symbols 
at the top and bottom of a design), the scale consfjkts qfJbwb 
different sections: requiring the application of either^'=? or 
t to a designj^ requiring several applications of "=1 and/or X 
to a design. Several sample items are worked collectively 
in each section. 
Grade bevel : 6 * 



Examples: Section I: 



Section II: 



End op with 



do X 



and thtn 



do X 
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Category G: Geometry 



61 Geometric Loci *' 

Abstract: Determine which picture Is described by a given statement^ where 
several pictures are given, each of which has identically placecf 
elements (aji^x,' an 'D' and a line) but a set of 

dots.^determine which picture a given statement describes. Firs:t 
statement is read by the tester. 

Grade bevel : 4 

Examples: '/^ 





In which picture are all the dots the same distance from the x? A B C D 

___ _ ' ^^sBri^ 

In which picture is each dot just as close to x as t^Tb? A B E F 



G2 Geometric Congraencies ^ , ' 

Abstract: Given a regular geometric shape dividethe shape into a certain 
number of congruent part s^ lTie 

Three correct and three incorrect solutions to a sample problem 
are examined collectively. 

Grade hevel : 5 • . 

Ex amples: 






171 
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Category &: Sebmetry 



G3 Geometric Categories 



Abstract: Given nine different geometric figures* identify a set of 2 to 7 
figures that are alike in some way, describe the distinguishing 
characteristic and label the f iguresaccbrdihgly. Go through 
this process as many times as' possible* Two examples are worked 
collectively. 



"Srade Level : ' 6 
Examples : 



1^1 ;*<.w 










Saoplt 1 All tht f1flur«« with "A" RrkJ€ ^ aft^ ftwj:!^ 
Sii^li 2 All tht flguris with "8" k^Ol rtnlij f u)<1-Sidg^-li^i^l»^-f 



All tht flggrts ii1t^"C" 



All tht figurtt with "D" 



etc, 
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Category 'b: tdgie 

LI kLdgi^aT^^dehtif icatrb 



Abstract: Given a specific set of Individaals, a specific set of character 
istics, the fact that^each individual has a distinct combination 
of characteristics, and several facts about some of the charac- 
ter4stjcs of some of the individuals, identify the characteris- 
tics of each individual. A smaller sample problem is Korked 
collectively. 



- r _ _ \ 

Grade Level: 6 



Example 



tn«»fl arv tM« 4 Mjrt: 1111 T» [g \ 



\ Bin pl4>« \mm^r% 

Ci jpffw'f plar MMMi-i ^ 1^ ^wiw't Pity ••ccflf. 



r Wtat 1fl4f«« «o*t flflcn toy »Uy In? (Clrclt >«wr tnfavn. ) 

ini: Intfoor ••cCflr •wt#wr MCC«r K— ir lk»c«fly MtiMr fk»cifly 

■__ 

L2 Making Sentences False ^ ' 

Abstract: Given a picture of a setof blocks arid a true seriteriee about 
them, make the seriteriee false by chariglrig the blocks. In rthe 
first two items, three suggested changes iri the blocks ire given 
and the student rieed brily rrark which tjries would falsify the 
senterice^ In the last three items, the studerit nw^st w^ite a 
change in the blocks. An item of the first type is worked 
collectively. . 

Grade bevel: 6 ^ . • z 

Exanfples: • Q^n^O 



JO£'S ItOtlCS 



••There are triangles above the line arid squares below the line.' 

a. Take away the triangles.. 

b. Take away the square^s below the line. 

c. Add squares above the line. 

- • - - - - - -- ----/- 

•Triangles go above the line or circles gb|below the line.* 
(Ybu write what Joe could do tb make the sentence false.) 
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Category- d: (Drganization of Data 



01 



Graphing Weight 
Abstract 



Siven a graph in which weight (axis labelled at 10 PQund 
increments for each.5 graph units) i^ frtotted^agairrst age (axis 
1 abeVl ed at 2 year j ncrements for each 2 gr aph un i t s ) , determi pe 
age per given weights and vice versa. One s^piple item is worked 
collectively. 



Grade bevel: 5 ^ 

Examples: How much did Bill we^h at 4 1/2 years of age? 

How old was Bill when he reached 90 pounds? — - 



02 Interpolating from a Table 
Abstract 



Given a table of prices for pipe of 4 different widths and 4 
different lengths, interpolate or extrapolate to obtain the 
|3rice on a pipe of given dimensions: at least one of which is 
hot shown in the table. Two sample items are worked collectively. 



Grade Level. 
Examples: 



Cpit of l^lpt 
Ltngth 





100* 


300* 


666' 


1,000* 




sso 


SI 50 


$300 


$500 


Irtdth ' 


$70 


$210 


S420 


$700 






S27b 


$540 


$900 




sii6 


S33b 


$660 


S1100 



HOH MUCH DDES IT. COST TO BUY PIPE WHICH IS: 

' . \ .., . 

6" x\00' = $ 

20" X 1000' i 
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Category P: -Probability 



PI Olddsihg the Best Box 

Abstract: Given threebqxes containing different combinations of 1, 2 and 
SO-cerit/talls*^* determine from which box it would be best to 
make a blind draw. 



Grade Level : 5,6 

A' 



Examples: 



miJ CH BOX WOULD YdU CHOOSE? 




® @ 



WHICH BOX WOULD YQtj iaOOSE? 



























©® 
























0® 






0 @) 







P2^ Dependent Outcomes 

Abstract: Given two (or tRree) fplhrieri and ah amount JlOj to be achieved 
dr exceeded to win^ select (from five standard choices) how 
often a player would win* Cbllectlvely Itlsshownhow a player 
could win or could lose with a specific set of spinners. 



Grade Level : 6 



Examples: 



two fdrmst approximately 3.5 minutes. 




Ifit tHtfi 
t1«t 



Half 
tim 



■ort thMn 
tlHI 





I 51 I f) (15 




\9tt tMn 
Mlf tht 

urn 



K«1f 

ttif 

t1«i 



00 rt tbifi 
Mlf 
tim 
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Appendix H 



Sumrnary of External Review of CSMP Materials, 1^74 
Dr. Shirley Hill; University of Misspuri at Kansas City 

s 

If this sample of mathematicians' opinions is in. any way representative -then I 
cannot help bat comment that the mathematical commanlty Is a lopg -way from 
any consensus concerning what mathematics is important and what sfejouid be ^ 
taaght, (The possibility that there coald be-agreament on how it is taug^nt is so * 
remote as to exclude hopje,) The diffiealty of . summarizing the five reports is 
exacerbated by the apparent fact that. iti^ reviewers' perceptions of their roJes 
and the purpose of their evaluatlbhs differed greatly. The reports seem to be 
addressed to different audiences and vary widely in degree of spp:lficlty^ in focus 
and in the.frarnevvbrk of tihne and vision (farsl^ted, shbrtsJghted, nearsigitfed,_ 
hindsight, foresight, thel'hbw,^" the future, the past, etc.)_wit^ih which an^ yilue 
judgment is imbedded.. Thu| I strongly urge any reader of this summary at leq^t 
to sRim each of the indivJdual rejDdrts. ^ - 

The overall impression of the materials was favorable; three reviewers expressed 
quite favdrable evaluations directly^ the reaction of another was mlxeH^ add the 
impression of the fifth cannot be said to be favorable, though it was not explicit- 
ly negative. 

QQ?_P?]ot Qen^raj agreement in the reports was on the SDundne^ of the 
'mathematical content. The material is seen to be mat^hemaHcdly^sound without 
§Gy_?9?Sj°ys technical or conceptual There were differences of opinion 

concerning matters of preference and taste in the development of the mathe- 
matical ideas. 

It was at least implicit In every report that it w^s Impossible to separate 
eompieteiy in an evaluation of this kind, matters of mathematics and n-iatfcers of 
pedagogy.. Certainly most of the differences in preference ebhcernlng the way 
the mathematics was presented had little to do with mathematical soundness but 
rather related to qaestions of learning, development, concept formation aid the 
likfe. Many of these are empirical (^estions. __I think that It Is fair to say. that 
mmi of the very specific comments and specific criticisms concern psychbJbglcal 
and pedagogical issues. 

An example of a currlcular element which Is a mix of hriathematlcal and peda- 
gogical issues Is the use of the minlcbhnputer. This Is the slrgle point of 
cbrTpletl agreemient among all reports. There Is tod, much reliance oh . the 
miniconiputer. Three reviewers vehemently opposed Its use as an aid altogether; 
the other two seriously question Its value In light of the very great investment of 
time. (Both of these reviewers agree that the effectiveness of the device with 
respect to cdmputatiqnal skills is an empirical question) All fls/te reviewers are 
dubious^^td very negative on the minicomputer's mixture of a blnsry and decimal 
base. , 

Are the materials Innovative, current^ timely? Comments ranged from "It is 
more of the- sarrie" to "the material Is refreshingly full of neyv Ideas." The 
majority were of "bhe opinion that the j^naterjals were tin^iely and current and in 
many instances excitingly new.^ One reviewer found much new material of which 
he could approve but too rriuch "old" material from the era of ''new inath." One 
found some "good sections" but little mathematics and much ''obsessive ritual." 

i 
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The'qUestidh of relevariciB is tricky^ as everyone knowsi •'Reievanee" has .no r 
meaning except in- this context of iDne's- cbjecUvKy vait^ 

i can only infer that are differences among the reviewers in^tt^ philoso- 

phical basis (Df their viisws of mathematics - what it is and whaL If does. Thus 
it is iffipbssible to summarize the tomm^nts telating to perceived relevance , of 
the miterial. There simply is no constant base ;for the opinions expressed. 
Certainly I; can ascertain no consistent ^aet of criteria for relevance. 

Let me offer some examples of these differences. One reviewer sees the authors 
of the materials as "ixiented to pure' mathematics" and working. in the "format of 
the past twenty years'," while another feels that the extent of ^%tuderit's partici- 
pation" and spontaneity is encouraging,, apparently viewing the rtiaterials as having 
moved beyond "tbe pr^c5cious discussions of systems and structure", of the past 
decade. 

One reviewer sees too rnuch carryover of material from the "new math" (I defy 
anyone to provide a clear-cut definition of that unfortunate term.) and views such 

material as faddish while another, believing in the need for rhdre historical 

perspective in distinguishing trends from fundamentals, cdrhpliments the authors on 
matntaining a balanced prograi^ that Ms timely and relevant today without dis- 
carding all the achievements of recent years. 

The majority of ceviewers__saw the materials as. modern, relevant to to^y^s trends 
in mathematics and its a^lications with potential for developing competent future 
mathematical users and problem-solvers. I 

I will end by^mentioning some specific things rhentioned in more than one review. 
All reviewers praised the inclusion of Extensive study of probability. Most Ig^^^ 
the material on relations and fLTictiohs, dn graphing and arrow diagrams, on 
combinatorics. 

______ 

Three reviewers 'specifically pointed to the "spiral development and saw this as a 
positive feature. These three reviewers also beneved the balance between 
concepts and applic^tidns was good. ^ Two specifically pointed out that the , 
activities stimulate active problem-solving and logical reasoning. 

Most xeview_ers were Critical of the^Sfterlal on sets, set xiperations, and Vern 
diagrams. Twd dppdsed the materi^]jllr«the properties of arithmetic operations. 
Two felt there should be rriore relianceibn manipulative, physical materials. 

As mentioned earlier, all reviewers were negative (in varying' degrees) about the 
mihicdrnpUter. j 
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